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We study statistical properties of peculiar responses in glassy systems at mesoscopic scales based 
on a class of mean-field spin-glass models which exhibit 1 step replica symmetry breaking. Under 
variation of a generic external field, a finite-sized sample of such a system exhibits a series of step wise 
responses which can be regarded as a finger print of the sample. We study in detail the statistical 
qq ' properties of the step structures based on a low temperature expansion approach and a replica 

approach. The spacings between the steps vanish in the thermodynamic limit so that arbitrary 
small but finite variation of the field induce infinitely many level crossings in the thermodynamic 
limit leading to a static chaos effect which yeilds a self- averaging, smooth macroscopic response. 
We also note that there is a strong analogy between the problem of step-wise responses in glassy 
systems at mesoscopic scales and intermittency in turbulent flows due to shocks. 



I. INTRODUCTION 



Glassy systems sometimes exhibit anomalously large macroscopic response to external perturbations. In the case 
of spin-glasses, the most well known effect is the so called anomaly: field cooled magnetization is significantly larger 
than zero field cooled magnetization [l[ . Because of the anomaly, aging effects clearlly appear in the magnetization in 
spin-glasses @, 0] • Another striking effect is the so called rejuvenation. For example spin-glasses aged (relaxed) for a 
long time can rejuvenate, i. e. restart aging, through small changes of the temperature Q or of the applied magnetic 
field [Hi. Similar phenomena have been observed in polymer glasses [f| 0, H, @] > relaxor ferro-electrics [l(| , deutron 
glass and other glassy systems. 

In order to understand these anomalous macroscopic effects, it is desirable to study what is going on at mesoscopic 
length and time scales. Indeed there is a class of phenomenological theories which assumes that mesoscopic excitations 

■ called droplets dictate physical xoproperties of glassy systems [IH, 0, [3 . It remains as a challenge to find these 
' droplets directly by experimental and theoretical studies. To this end, one must find sensible ways to work directly 

OO ■ at mesoscopic scales escaping from the inevitable self-averaging mechanism working at larger scales. 

Experimental studies of magnetoresistence in mesoscopic spin-glass samples [16| have proved that magnetoresistence 
provides a fingerprint of a given sample reflecting its frozen-in spin-pattern. Quite interestingly changes of statistical 
weights of a few low lying states under magnetic field has been observed [l7|, which suggests level crossings among 
low lying excited states due to the variation of the magnetic field. Mesoscopic measurements also appear promising 
for other glassy systems such as vorticies in super-conductors[l8j and polymer glasses fl9| . 

To make a step forward from a theoretical side, we study in the present paper statistical properties of responses 

■ in a class of mean field systems of finite sizes N. A great advantage of the mean field approach is that it allows us 
to obtain results analytically from a given microscopic hamiltonian. It will gives us a generic mean-field picture for 

O ■ peculiar properties at mesoscopic scales in glassy systems. The latter may provide us hints to develop droplet pictures 
for broader classes of glassy systems. 

Somewhat surprisingly statistical properties of finite sized systems have not been explored extensively in the studies 
of mean-field models. The present work is motivated by an interesting numerical observation by Kirkpatrik and Young 
[2fj| who showed that the magnetization of a finite sized sample of the Sherrington-Kirkpatric (SK) model, that is given 
by a certain realization of random interaction bonds between the spins, grows in a step-wise manner as a function 
of the applied magnetic field. Note that in the thermodynamic limit the magnetization curve (per spin), which is a 
thermodynamic quantity, must converge to a unique limit independent samples. Later it was suggested by Young, 
Bray and Moore [2l| that the fact that linear-susceptibilities are non self-averaging in mean-field models reflects the 
step- wise responses. Quite interestingly similar observation has been done numerically in directed polymer in random 
media [22| by Mezard, suggesting that the step-wise response is not a pathology only found in mean-field models. 
Our work is also motivated by a seminal work by Krzakala and Martin (KM) [24[ who considered an extended version 
of Derrida's random-energy-model (REM) [2|| to analyze chaotic resuffling of low lysing states under variation of a 
generic external field. An important basis of our present work is the idea of generalized complexity introduced in our 
previous work [26| which is motivated by the work by KM. 
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In the present paper we focus on a class of mean-field spin-glass models which exhibit 1 step replica symmetry 
breaking (RSB), which is analytically and physically more tractable than the systems with full RSB such as the SK 
model mentioned above. By a combination of a low temperature expansion approach and a replica approach we analyze 
statistical properties of the step-wise responses of finite sized systems. We will identify three characteristic scales for 
the steps, namely its height (per spin) A/y/N , width h w ~ T/Ay/N at temperature T and spacing h s ~ T c /Ayf~N 
with T c being the critical temperature. In the thermodynamic limit N — > oo, the steps become invisible leading to 
apparently smooth macroscopic response. 

The static step-wise response reflects level crossings among low lying metastable-states, which are the solutions of 
the Thouless- Anderson-Palmer (TAP) equation [28| in the mean-field models, under variation of the external field. In 
the systems with 1 step RSB, the metastable states have zero overlap with respect to each other meaning that (spin) 
configurations are completely different on different metastable states. Thus variation of the external field completely 
change the energy-landscape, called the static chaos effect [l^, EH HH, [36j]. It is worth to note that the static chaos 
effect, which appear at macroscopic scales [H,|35|], emerge as step- wise, intermittent responses at mesoscopic scales. 
Actually step-wise response itself is not at all new in frustrated systesm which oftenly exibit sequence of phase 
transitions. Most well known example may be the Devil's stair cases in the magnetization curve of the ANNI (axial- 
next-nearest-neighbour Ising) models [29(. In this respect, a distinct feature of the case of static chaos effect is that 
there is a continuous sequence of steps (phase transitions) in the thermodynamic limit. It is also amusing to note 
that there is an intimate analogy among the present problem of step- wise responses in glassy systems at mesoscopic 
scales, jerky e ffective energy landscape of pinned elastic manifolds [301 ] . and intermittency in turbulent flows due to 
shocks I3IH32I. [331] . as we explain in the end of the present paper. 

The organization of the paper is as follows. In sec.|TT]we introduce our models and sketch basic features of their step- 
wise responses. In sec. lllll we revisit the generalized complexity introduced in [26| . Based on the latter we first discuss 
macroscopic responses from a general point of view. Then we analyze statistical properties of low lying metastable 
states which will serve as a basis for the analysis of mesoscopic responses. In sec. II VI we analyze statistical properties 
of the mesoscopic responses by a low temperature expansion scheme. Then in sec. |V]we analyze the problem again 
by a replica approach. In sec. IVII we discuss connections between our problem and related problems including the 
intermittency in tubulent flows. In sec. lVIII we summarize our result and discuss some perspectives. In the appendices 
we report some details. 

II. STEP- WISE RESPONSES IN FINITE SIZED MEAN-FIELD MODELS 

In the present paper we consider a generic class of mean field spin-glass models which exhibit static glass transitions 
with 1 step RSB. By now it is well known that the generic phenology of such a class of models capure quite well static 
and dynamical properties of real glassy systems [38|, H^, Ho] ■ 

A. p-spin mean- field spin-glass model 

As a representative model let us take the p-spin Ising mean-field spin-glass model [2^, [44| whose hamiltonian is 
given by, 

H=- Jix,-,ip a ix •■■ (J ip ~ h^O-i- (1) 

Here a (i = 1, . . . , N) are Ising variables which are coupled with each other by p-body random interactions i 
and subjected to an external field of strength h. The coupling Ji lt ... t i follows a Gaussian distribution with zero mean 

[4 if ]=o [jL.., ip ]= j2 ^i ( 2 ) 

Here and in the following we denote averages over different realizations of the quenched randomness as |[. . .|. 

For p > 2 the p-spin Ising model exhibists a static phase transition from the paramagnetic (liquid) phase to glassy 
phase characterized by 1 step RSB. We note the transition temperature, which is usually interperted as the so called 
Kauzmann temperature, as T c in the present paper. 

We wish to examine changes of the magnetization 
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FIG. 1: Magnetization curve in a small sample of a p — 3 Ising mean-field spin-glass model. The solid step-wise curve is the 
equilbrium values of the magnetization m = X/i^*)* 1 a ^ T/J = 0.1 and at various values of the external field h obained 

by an exact enumerations of the partition function of a N = 16 system. The S shaped line (cross) is obtained by taking averages 
over large number of samples, which actually has only very weak finite size effects so that it is very close to the thermodynamic 
one N — » oo. The spiky curves is the linear susceptibility x = {P/N) ^2ij({SiSj)h — (Si)h(Sj)h) with [3 = 1/T. Similar features 
have been observed in the SK model (p = 2) see [2(| and directed polymer in random media 



under variation of the extenral field h in finite sized systems of N spins at temperatures below T c . Here and in the 
following we denote thermal avarages as (...). In section fVl we derive the generating functional for the mesoscopic 
magnetic responses in this model. 

For an illustration we show in Fig. [1] an example of magnetization curve observed numerically in a certain small 
sample of p = 3 model. By a sample we mean a specific realization of the bonds in Eq. |T]). Note the step- 
wise increase of the magnetization /x under increase of the magnetic field h. The pattern of the steps depend on 
each realization of samples so that it can be regarded as a fingerprint of a given sample. Note also that the linear 
susceptibility x is quite spiky and significant only in the visinity of the steps. 

On the other hand we know that in the thermodynamic limit N — > oo the magnetization curve must converge to a 
unique limit independently of samples. Thus the steps obserbed in mesoscopic (finite sized) samples must somehow 
disappear in N — > oo limit. But how? 

A similar observation has been made also in the SK model by Kirkpatrick and Young [2(| ■ Young, Bray and Moore 
(2l| have argued that 2the step-wise response reflects crossings of free-energies of low lying metastable states under 
variation of the magnetic field. Mezard has discussed similar phenomena in the directed polymer in random media 




In our present paper we consider the 1 step RSB mean-field models instead of the full RSB models like the SK 
model. The 1 step RSB models are techinically and conceptually much simpler than the full RSB models and allow 
us to perform much more detailed, direct analysis on the mesossopic responses. 



B. effective random energy model 

In most parts of the present paper we consider more simplied models called random energy models (REM) which 
are suited for our purposes for various reasons. 

Formally, Derrida's original REM [25l . l44j can be derived by considering the limiting case p — > oo of the p-spin 
model given above. In this limit the model allows analytical calucurations to a great extent. 

Physically the mesoscopic step-wise response arise from jumps between different metastable states (inter-state 
response). In this respect, responses within each metastable states (intra-state response) are irrelvant from our point 
of view. In the REM the intra-state responses automatically vanish so that we can avoide to work hard to disentabgle 
intra-state and inter-state responses. 
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The partition function of the REM at temperature T = (3 1 under the field h can be written as, 

ZMM-Y.e-KV-W (4) 

i=i 

Here i = 1 . . . e Nc (c > 0) is the label for the metastable states. F a is the free-energy of the metastable state a at 
h = and Y a is a variable which is conjugate to the external held h. 

In the case of magnetic systems, as the original REM by Derrida (25[, the variable Y corresponds to the magneti- 
zation which takes random values at different metastable states. However in the present paper we wish to leave it as 
a generic extensive random variable conjugated to a generic external held h, in the same sprit of the seminal work by 
Krzakala and Martin (KM) [24]. We may call such a model as an effective REM. As far as the inter-state responses 
are concerned, the effective REM should correctly simulate a given original model which exhibits 1 step RSB. 

Then the eseential ingredient we need to know is the density of metastable states at a give value of the free- 
energy F and the variable Y. The metastable states are obtained as the solutions of the equation of states called 
Thouless- Anderson-Palmer (TAP) equations [28[. In a previous work [26[ we have given an analytic recipe to compute 
the logarithm of such a density of states, which we called generalized complexity from the TAP equation of a given 
microscopic model. 

In Fig. [2] a) we show an example of the profile of the response observed in a REM. In Fig. 0b) it can be seen that 
free-energies of low lying states exhibit level crossings precisely at the 'critical fields' h c corresponding to the edges of 
the staircases of the response curve y(h) = (Y) /N. 



C. Some basic features of the step- wise responses 




FIG. 2: Step wise responses and level-crossings of the free-energies in an effective REM. Here we used the toy model proposed 
by Krzakala and Martin [24| . (See sec. Mil and appendix [B] for the details.) In a) the solid (red) line which exhibits a sequence 
of steps is the response curve y(h) computed numerically in a certain finite size (N = 17) sample of a model specified by the 
density of state Eq. (|I7[) with c = 2 In 2, A = 1 at temperature T/T c ° = 0.1. Here T c ° = l/v2c is the critical temperature of 
the model under h = (See appendix [B} . The linear susceptibility xC 1 ); an d all non-linear susceptibilities Xn(h) with n > 2 
(not shown), exhibit spikes at the edges of the staircases. The step-structures become finer as N is increased. The doted (blue) 
lines represent local Taylor expansions of the response curve const + + X2 (Sh) 2 + \2 {Sh) 3 + \2 (5h) 4 wit 8h being distances 
from the points indicated by the arrows. The (black) dashed line is the response curve in the thermodynamic limit obtained by 
taking first derivative of the total free-energy density in the thermodynamic limit (f')*(h) given in Eq. ()B10[I with respect to h. 
The qualitative difference between thermodynamic susceptibilities obtained by limsh^o lmijv^oo and susceptibilities associated 
with fluctuations (FDT) obtained by limjv->oo limsh^o is clear. In b) the evolution of the free-energy densities // = /j — hyi 
under varying h for several low lying states are shown by solid (black) lines. The free-energy density of the total system is 
shown by the solid (red) line. The dashed line is the free-energy density in the thermodynamic limit (f')*(h) given in Eq. (jBTOj . 



In the present paper we wish to characterize statistical properties of the step- wise responses in mesoscopic samples 
explicitely. By mesoscopic we mean that N is significantly larger than 1 but not infinitely large. Our main result 
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is that there are three important characteristic scales of the steps in the 1 step RSB mean-field models: 1 ) typical 
height of a step AY , 2) typical spacing h s between the steps and 3) typical width h w of a step over which the step 
is rounded at finite temperatures T. Their orders of magnitudes are obtained as, 

AY~A cS (h)VN h s ZK^) h ^—f= (5) 

where A e g(h) characterize strength of the fluctuation of the quantity Y — Ny conjugated to the external field h 
over different metastable states and T c (h) is the critical temperature under external field of strength h. In the 
thermodynamic limit N — > oo, the spacing h s between the steps vanish and the response curve converges to a unique 
limit. 

We arrive at the above conlcusion by analyzing anomalous scaling properties of thermal fluctuations associated 
with the steps, distribution function of the response in the zero temperature limit and decorrelation of two real replica 
systems subjected to different fields. We study these properties by two approaches : a low temperature expansion 
approach in section IIVI and a replica approach in section [VJ 



1. Anomalous thermal fluctuations 

A set of useful quantities which characterize the step-wise responses are linear and non-linear susceptibilities 

d n (y(h + Sh)) 



Xn{h) 



d5h r - 



(n=l,2,...,) (6) 

Sh=0 



which exhibit series of spikes along the h axis as shown in Fig. Q] and Fig. [5] Note that the susceptibilities become 
significant only in close vicinities of the edges of the staircases, 

Xn ~ O (AY/i~ n ) (around the edges of the steps) (7) 

and remain almost zero elsewhere. Thus a given sample under a given value of h may or may not have large 
susceptibilities: it will have large susceptibilities only if it happens to have a 'critical field' h c (edge of a step) close 
enough to h. Thus we naturally expect that linear and all non-linear susceptibilities are not self-averaging, as first 
pointed out by Young, Bray and Moore [2l[ in the SK model. 

The susceptibilities are related to connected correlation functions of the Y variable through the static fluctuation 
dissipation theorem (FDT). FDT is derived by expanding the free-energy Nfj(T, h + 8h) of a given sample, say J, in 
power series of an infinitesimal shift in the field Sh, 

~ N(3fj(T, h + Sh)- {-N(3fj{T, h)) = ln(e^' iy ) = /36h Kl (Y) + M! K2 (Y) + H^t K3 (Y) + ... (8) 

where (• • • ) stands for weighted averages within the 'unperturbed system' (Sh = 0). We denote the n-th thermal 
cumulant moments (or connected correlation functions) of the variable Y as k n (Y). The first few moments read as 
Kl (Y) = (Y), k 2 (Y) = (Y 2 ) - (Y> 2 , k 3 (Y) = (Y 3 ) - 3 (Y 2 ) (Y) + 2 (Y) 3 , k 4 (Y) = (Y 4 ) - 4 (Y) (Y 3 ) + 6 (Y) 2 (Y 2 ) - 

3 (Y) . The above power series yields the usual static FDT; a change of Y induced by an infinitesimal increment of 
the field Sh can be written as 

SYj = xiSh + X 2(Sh) 2 + X3 (Sh) 3 + ... (9) 

with 

Xi=/3x 2 (Y) X 2 = (/? 2 /2!)« 3 (Y) X3 = (/3 3 /3!) K4 (Y) ... (10) 

where \i is the linear susceptibility and X2, X3 r ■ ■ are non-linear susceptibilities of a given sample J. If the thermal 
fluctuation of Y is Gaussian, as it happens at T > T c , higher connected correlation functions vanishes K n {Y) = for 
ii > 3 and thus the non-linear susceptibilities vanish. 

At around the edge of the steps where the response is significant (See Eq. ([7])) the response may be described by a 
Taylor expansion, 



oo 



5Yj = AYyc n [^\ (111 



n—l 
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with c„ being 0(1) numerical coefficients. Note that here the small parameter for the expansion is h/h w with h w 
being the width of the thermal rounding of the steps given in Eq. This is indeed evident in the plot of Fig. [2] a) 
where we show some examples of truncated Taylor expansions of the response curve y(h) at several points along the 
h axis (marked by arrows). Around the edges of the steps, the local Taylor expansion provides a good approximation 
only for sufficiently close neighbourhood of width h w . Thus "linear response theories" can not be invoked to estimate 
responses beyond the scale of a single step h s which actually vanishes in the thermodynamic limit N — - > oo. (See 
Eq. ©) 

Then one can notice that thermodynamic susceptibilities obtained in the limit lima/^o hmjv— >oo i-e. taking deriva- 
tives of 'smooth thermodynamic free-energy density', and susceptibilities associated with fluctuations (FDT) obtained 
in the other way around limjv^oo lim^^g, which directly reflect 'rugged free-energy landscape', are completely dif- 
ferent objects. In short the two limits are not commutative everywhere in the glass phase, 

lim lim ^ lim lim . (12) 

The non-commutativity of the two limits signals the presence of the steps. 

On passing let us note that disorder-average of the linear susceptibility defined via static fluctuation dissipation 
theorem (FDT) must agree with the 1st derivative of the thermodynamic response curve in a rather accidental manner 
as discussed in appendix El Importantly the equivalence does not hold for the non-linear susceptibilities. Although 
the value of linear susceptibility obtained via FDT coincides, after averaging it over disorder, with the 'thermodynamic 
linear susceptibility', it must be emphasized that the meaning of 'linear responses' is totally different in the two cases. 
As can be seen in Fig. [2 linear response approximation is apparently not so bad for the thermodynamic response 
curve while we realize it is almost a nonsense in a given finite sized sample. 



2. Sharp response in T — > limit 



The expansion of the response via FDT cannot go beyond the scale of a single step. In particular, in the close 
vicinity of the edges of the steps the Taylor expansion is valid only within the thermal width of the step h w (See 
Eq. (jlip ). Moreover the thermal width h w vanishes in the zero temperature limit T — > at which the step structure 
becomes most clear. Thus it is tempting to look for another way to analyze the mesoscopic step- wise responses without 
relying on the FDT, which hopefully works at zero temperature. 

By both the low temperature expansion method and the replica method, we will demonstrate that it is indeed 
possible to take T — > limit first and study mesoscopic responses consisting of successive sharp steps within small 
increments of the field Sh. Interestingly enough, we will otbain another series expansion of the mesoscopic response 
in which the relvant small parameter is Sh/h s instead of Sh/h w which appears in the FDT case (Note that h w < h s 
since T < T c (h)). Thus the two limts T — > and Sh — ► are not commutative, 

lim lim ^ lim lim . (13) 

ilnOM T— »0 Sh—tO 

Somewhat unexpectedly, the approach limy^o limj/,^0 allows us to go beyond the limit of single step. We will find 
that the 0(Sh/h s ) term in the series corresponds to the case that only single step is present in a given interval Sh, 
0(Sh/h s ) 2 term to the case of two steps, and so on. 



3. Cusp in the overlap: a mesoscopic aspect of the chaos effect 



In addition to the response of the variable, say Y cojugated to a given external held h, we examine the change of 
the corelation function between two replicas subjected to slightly different fields, 



C(Sh) 



_\[(Y(h-Sh))(Y(h + Sh))] 



(Y(h)Y 



(14) 



under variation of Sh. This kind of correlation function or overlap function is oftenly used to analyze the static chaos 
effects known in spin-glasses and related systems [H, 0, [T3, l34l l36l l37l l47l. [Hoj. 

We are sure that the correlation function must vanish C — > for any small but hnte variation of the held in the 
thermodynamic limit N — ► oo, i.e. chaos. This is because in such a circumstance there will certainly be level crossings 
between different metastable states which have zero overlap with respect to each other in 1 step RSB models [26j . 
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Our interest here is to look at how it decays as Sh is increased in mesoscopic (finite sized) samples. To this end we 
analyze Eq. (|14[) at finite temperatures using the FDT approach and also directly at T — > limit without relying on 
the FDT. We will find that the overlap C(5h) exhibists a cusp singularity at Sh = in T — > limit, which is rounded 
at finite temperatures over the scale h w , and that the width of the cusp is given by h s (See Eq. (O). Somewhat 
unexpectedly, as we discuss in section IVI1 the overlap function has counterparts which describe the jerky effective 
energy landscape of pinned elastic manifolds [30l | and intermittencies due to shocks in turbulence [32j • 



III. GENERALIZED COMPLEXITY 



Now let us discuss some generic features of the density of the metastablestates (TAP states). As we noted in in sec 
IIIB[ the effective REM can be constracted based only on this information (See Eq. ([4|)). 

We consider an ensemble of metastable states z = 1,2,... each of which is a solution of the TAP equations of states 
at a given temperature T and an external field h. We denote the free-energy of a TAP state, say a, as F a = Nf a and 
the extensive variable conjugated to h as Y a = Ny a — —Ndf a /dh. 

We rewrite the partition function of a given sample of the effective REM Eq. f4} at temperature T and under 
slightly shifeted external field h + Sh with small enough Sh as [H, HH , 

Z R em(T, h + 5h) = Y, e" = f dfdye N W>y^- Sh yV (15) 

where (3 = 1/T. Here £(/, y) is the generalized complexity [26] defined as the logarithm of the density of states with 
respect to the two variables / and y, 

W,y) = ^ogJ2S(f-f a )S(y-y a ). (16) 

a 

In general [26| we expect that the generalized complexity S( f, y) can be presented as a surface S = £(/, y) which 
is convex upward as shown schematically in Fig. [3J See [261 ] for an analytical recipe to compute the generalized 




FIG. 3: The generalized complexity E = £(/, y) have a shape like a surface of a bell cut by E = plane. The dashed line on 
the E = plane is the zero complexity curve E(/, y) = 0. The surface S(f') is normal to the axis of the 'total free-energy' 
/ — Shy and cut the latter at /' = / — Shy. Cross section between the plane S(f') and the complexity surface E = E(/, y) 
defines a curve C on which the complexity is maximized at a peak P = P(f'). 
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complexity of a given microscopic model. Note that in general £(/, y) can depend both on the temperature T and 
external field h. 

As a toy model we can use the model propose by Krzakala and Martin (KM) [24] in which the generaized complexity 
takes a particulary simple form, 

mv) = c-£-iL, (17) 

which depends neither on the temperautre T nor the field h. In appendix [B] we summarize some basic properties 
of the model. We will find that it gives generic results concerning inter-state responses common for all 1 step RSB 
models in the glass phase. 



A. Thermodynamic response 

In the thermodynamic limit N — > oo, at a given temperature T and under an external field h + Sh, the partition 
function Eq. (|15p is dominated by contribution from a certain saddle point (/* , y* ) which parametrize a particular set 
of TAP states. Then thermodynamic value of Y variable is given by Y = Ny* and the thermodynamic free-energy is 
given by F' = N{f* - Shy*). 

The saddle point (f*,y*) can be located as the following. Let us consider the three-dimensional space (/, y, S) 
as shown in Fig. [3l Consider a plane S = S(f') on which the total free-energy density takes a constant value 
/ — Shy = f. Cross section between S(f') and the complexity surface £ = £(/, y) defines a line C = C(S) along 
which the complexity takes a maximum value at a certain point P = P(C). Then for each value of /' we have a 
unique point P = P(f') associated with it. Now we look for a special point P* = (/*, y* , £*) such that it satisfies, 



df 



= L (18) 
p=p* 1 



It is easy to verify that (f*,y*) is the saddle point which dominates the partition function Eq. (|15|) and £* is the 
value of the complexity at the saddle point. 

As the temperature T is lowered under a fixed value of the external field h, the point P* moves downward on the 
complexity surface. At a certain critical temperature T — T c (h), the value £* of the complexity at the point P* 
becomes 0. As the temperatures is lowered further the point P* remains pinned there. Thus the system is understood 
to be in the glass phase where £* — at lower temperatures T < T c (h). 

Within the glass phase T < T c , the saddle point moves smoothly along the zero complexity line £(/, y) = under 
variation of the extenal field h. The equilibrium values of the parameters (f*(h + Sh),y*(h + Sh)) under a given 
external field h + Sh is simply obtained by looking for a line / — Shy = /' with slope Sh which is tangent to the zero 
complexity curve £(/, y) — 0. The touch point is nothing but the saddle point (f*(h + Sh), y*(h + Sh)) [26| . 

By varing h, the equilbrium value of y*(h) will change smoothly. Consequently all linear and non- linear suscepibil- 
ities 



d n y*(h + Sh) 

Xn(h) = 



dSh r - 



(19) 

5h=0 



will be smooth functions of h. Note that these are thermodynamic susceptibilities which are obtained by taking 
thermodynamic limit N — > oo before taking derivatives with respect to h. 

The fact that (f*,y*) varies with h means that strong chaos is induced by extensive level crossings in the 1 step RSB 
systems (26J: a set of TAP states which dominates the equilibrium states at a given value of h becomes completely 
out-of-equilibrium at h + Aft,. However, thermodynamic response itself is completely smooth and featureless, which 
ironically provides us no hint of the underlying chaos effect. Thus we are naturally lead to go down to smaller scales 
to look for some traces of the chaos effect. 

In appendix [Bl we rephrase the above discussion based on the toy model Eq. (|17| . 



B. Low lying states close to E = line 



We are interested in the glassy phase T < T c (h) so that the shape of the complexity around the saddle point 
(f*(h),y*(h)) on the zero complexity line £ = will be particularly important. A generic shape around the saddle 
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FIG. 4: Spacing between low lying states. Adjacent free-energy levels (1, 0),(2, l),...are not repulsive to each other. More 
generically, free-energies of l-th and m-th states with |Z — m| > 1 are "repulsive" to each other. 



point close to £ = may be cast into a form like, 

my) ^^(h) 2A^F~ (20) 

where yp(f) describes the position of the peak P (see Fig. [3]) at a given value of /. The latter may be described by 
a Taylor expansion, 

yp(f) = y*(h) - a(h)(f - f*(h)) + o((f - f(h)f). (21) 

with a{h) being a certain constant. 

The functional form Eq. ([20]) suggests us to introduce a new variable Y, 

Y = Ny y = y-y p (f), (22) 

Then we can rewrite the generalized complexity Eq. ([20]) as, 



f-f(fe) 

~ T c (h) 27VA eff (/i)2 1 > 

Note that this means the density of states e WE ' = ' is decoupled into two parts: exponential distribution function for 
the free-energy and Gaussian distribution function for the transverse variable Y . In the present paper we call Y as 
transverse variable. 

In appendix [B] we rephrase the above discussion based on the toy model Eq. (| 17[) . In particular we find that the 
complexity of the model behaves as Eq. ([23]) close to the £ = plane so that it should give generic results common 
in all 1 step RSB models concerning inter-state responses below T c (h). 



1. Level spacings among the low-lying states 



From Eq. (12"3"[) we find that the total free-energy F of low lying states (F — F*)/T c (h) w O(l) follow an exponential 
distribution [461 ] . 

p(F)^eM(F-F*)/T c (h)). (24) 

Now let us order the states as I — 0, 1, 2, . . . according to the value of their total free-energies Fi such that Fq < F% < 
F2 ■ ■ ■■ We will need in particular the information of the statistics of level-spcacings: differences between free-energies, 



AF (! , m) =Fi-F m l>m. 



(25) 



10 



Recently Bertin [54j have shown that spacing between random numbers drawn from an exponential distribution 
function exactly obey a class of exponential distribution laws. Following his proof we find from Eq. that free- 
energy gaps of adjacent levels AFn^-ij follow an /-dependent exponential distribution^. 

I , AF (i,i-i) 

PCLi-DfAFp,,.!)) = — e~ l ^~. (26) 

The exponential form Eq. (|26p implies absence of repulsions between adjacent levels in the sense that 
lim x _>o p(i t i-i)(x) > (See Fig. On the other hand we find distribution of the free-energy difference between 
I + 1-th and I — 1-th states using Eq. ([26]) as, 



. AF,, 



(AF ) - + l) (;+ i) AF ('+M-D / / , , 

- — f e c I )' ^ ' 

This implies a certain effective level repulsion between /—1-th and /+l-th states in the sense that lim^^o P(i+i,l— l) ( x ) — 
0. (See Fig.|4j). Thus the free-energy levels are not too much degenerate: only a few low lying states dominate the static 
properties in the glassy phase in contrast the liquid phase T > T c (h) where exponentially many states contribute. 



2. Distribution of the transverse variable Y 

A remarkable feature of the transverse variable Y is that it is statistically independent from the free- energy. From 
Eq. (|23|) . we find Yi follows a simple Gaussian distribution, 

p ™ = ^ra exp ("^(w)- (28) 

which is independent of I, i. e. independent of the free-energy. 

The original Y variable depends both on the transverse variable Y and the free-energy F, 

Y _ Y * = Y + a(h)(F - F*) (29) 

which follows from Eq. (|22|) . Here it is evident that thermal fluctuations and responses to the field of Y is dominated 
by that of Y. 

Thus for the rest of this paper we will focus on thermal fluctuations of the variable Y instead of Y . Correspondintly 
we will consider to apply a fictitious field conjugated to the tranverse variable Y and examine its response. We will 
frequently denote Y simply as Y for simplicity. 



3. Discussions 



The most important features of the density of states specified by the generalized complexity Eq. ((23)) are the 
following two points: 1) In a finite fraction of samples low lying states are almost degenerate and 2) Existence of the 
transverse variable. The combination of the two points yield the step-wise responses in the glass phase at mesoscopic 
scales: a fraction samples can make a large response of order A c s>/N even by an infinitesimally small variation of 
the field. Note that the situation must be distiguished from that in the liquid phase T > T c (h) where all samples 
respond. In contrast the response is intermittent in the glass phase because only some finite fraction of the samples 
are ready to respond to infenitesimal fields. 

While the thermal fluctuations of the free-energy F is necessarily of 0(T), thermal fluctuations of the transverse 
variable Y can be of order 0(A e ff (h)VN). Thus Y is reminiscent of the Goldstone modes in the sense that it can 
make large thermal fluctuations and also large respons to small variations of the external field even at very low 
temperatures. (See [22|, [23| for related discussions in the problem of directed polymer in random media.) 

In the case of the magnetic perturbation, the variance A e ff of the magnetization is related to the Edwards- Anderson 
(EA) order parameter ^ea as A B ff = ^/9ea under zero external magnetic field h = [2(|. The latter has been also 
noticed by Franz and Virasoro [55j in the context of dynamics. 

The situation will change qualitatively if there are level-repulsions between adjacent free-energy levels as in the 
familiar Wigncr's distribution. It will also depend on the the parameter A c g. Chaos will be absent for a perturbation 
with A ff = 0. 
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Interestingly enough quite similar properties as 1) 2) are assumed and plays prominent roles in the phenomenological 
Imry-Ma type droplet scaling arguments for glassy systems [l^, [H, Q, [U |4?J which assume thermally active rare 
low-energy excitations called droplet excitations. The difference between the present mean field theory is that the 
characteristic energy scale T c is replaced by typical energy scale of droplet excitations which grows with the system 
size L,. 

T c "mean field" -> T{L/L ) 9 "droplet" 

Here the exponent 9 > is usually called stiffness exponent and L is a certain length scale beyond which the power 
law behaviour holds. Such an intriguing analogy has been pointed out in some literatures [30H4l|. 



IV. LOW TEMPERATURE EXPANSION APPROACH ON MESOSCOPIC RESPONSES 



We now analyze responses at mesoscopic scales by a low temperature expansion approach on the effective REM. 
To this end, it is convenient to rewrite the partition function Eq. (j4| of a given sample as, 

Af-i / I \ 
Zj = e~ m > ex P -I 3 AFk + P ShY i ■ ( 3 °) 

1=0 V k=X ) 

Here the index I = 0, 1, . . . , M — 1 label the states in an ascending order of the values of their free-energies, i.e 
Fq < F\ < . . . < Fm-x- The free-energy gaps AFi = Fi + i — Fi follow the /-dependent exponential distribution 
Eq. (|26p . The variables Yi are understood as the transverse variable which is statistically independent from the 
free-energy at Sh = 0. For simplicity we denote it as Y. 



A. A first look by a simple two- level model 



First let us look at a simple two-level model to get some basic insights. The two- level model is defined such 
that it consists of only the two lowest levels in a given sample disregarding higher levels: the sum over the states 
I = 1,2, ... ,M in the partition function Eq. ([30|) is truncated at I = 2. In the next section we will actually find that 
this simple two-level model gives quantitatively correct results up to 0(T/T c (h)) which is a good approximation at 
low enough temperatures. Contributions from higher levels give only moderate correction terms of higher order in 
T/T c (h). 

Let us consider a two- level system at temperature T and under external field ho- It is easy to see that the response 
(y)h ~ (y)h by varitaion of the field can be expanded in power series of Sh = h — ho as 

^|MV A^M (31) 



AY ^ V K 

n— 



with AF = Fx — F , AY = Yx- Y , x n (y) = and 

AF T 

hc = ho + ^y hw =AY- ( 32 > 

The above observation readily suggests the three important characteristic scales of steps announced in Eq. ([5]). 
First, the scale of a single step is given by Ay whose typical magnitude is, 



AF - ViVAeft. (33) 

as Eq. (|28[) implies. Second, the distance from a given ho to the nearby 'critical field' h c where a level crossing take 
place is given by h c — ho = AF/AY. Typical order of magnitude of the latter is, 

- - Tc{h) (34) 



NA cS 

This follows from Eq. (|26|) which implies typically AF ~ T c (h). Lastly h w introduced in Eq. (|32|) defines the scale of 
thermal width over which which the edge of a step is rounded at temperature T. We readily find, 



(35) 
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FIG. 5: Profiles of linear and non-linear susceptibilities associated with a step. The solid (red) line represents a model function 
of a step (y) /AY = [1 + e ~ ih ~ hc)/Kv ']- 1 with K = 0.5. The others are susceptibilities Xn/AY = d n {{y) /AY)/dh n which have 
significant amplitudes only in a narrow region of the thermal width /i w around the critical field' h c . Note also that sings of the 
non-linear susceptibilities oscillate. 



Note that h w is the scale up to which a local Taylor expansions of the response around the edges of the steps converge 
as noted in Eq. (fTTj) . 

From Eq. (|3"Tj) the susceptibilities are obtained as 

*.(*)- AT JLfc(»^) (36) 

which are displayed in Fig. [5] Note that they are significant only within the thermal width h w around the critical field 
h c . Since AF and Ay fluctuate from sample-to-sample, a given sample will have significant susceptibilities under a 
given external field h only if the distance to the critical field h s = h c — h a happens to be smaller than the thermal 
width h w . A simple minded estimate of the probably to actually have such a sample is, 

h i=°(m)) (37) 

which becomes small at low temperatures T <C T c (h). With such a small probability the susceptibility of a given 
sample take significantly large values, 

Xn ~ &Yh- n ~ (Aeff) 1+n JV< 1+n )/2 (38) 

while they remain negligible otherwise. 

From Eq. (|37[) and Eq. (|38[) we find sample-average of p-th moment of Xn is dominated by the rare sample and 
behave as, 

ttf] ~ (AYh~ n y^ ~ [ (Acff) i+«iv(i+«)/2] P (39) 

Thus the sample-to-sample fluctuations of the susceptibilities are very far from Gaussian and non-self averaging. For 
instance we find, 



[xi] / T 



(kW \Tc(h) 



(40) 



The above argument based on the two-level model is surprisingly similar to the typical Imry-Ma type scaling 
arguments in the droplet phenomenology [l3l Indeed let us note that a very similar Imry-Ma type scaling 

argument has been constracted for directed polymer in random media subjected to tilt field [22j |. 
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FIG. 6: Schematic pictures of free-energy levels close to a 'critical field' h c . (Left) A case when lowest two levels / = 0, 1 
come close to each other with a separation of only 0(T). Rare samples which realize such a situation under a given h make 
0(T/T c (h)) contributions to the thermal cumulants under the given h. 2-level models take into account such samples correctly. 
(Right) A case when lowest three levels I = 0, 1, 2 come close to each other simultaneously. Such rare samples make 0(T/T c (h)) 2 
contributions. 3-level models are needed to take into account such samples correctly. 



B. Sample-to-sample fluctuations of linear and non-linear susceptibilities 



Now we study thermal fluctuations associated with the steps more systematically. Our task is to compute k-th 
thermal cumulants of Y (more precisely Y) and examine its moments, 



( d h 



\d{fiShf 



■ In Z(h + Sh) 



in 



( d k2 



\d(/35h) h 



■]nZ(h + Sh) 



r- 






6h=0- 



(41) 



where Z((h + Sh) is the partition function and [■ • •] denotes the average over different realizations of samples. Here 
we compute them by a low temperature expansion approach. Later in section TV Bl we confirm the results by a replica 
approach. 

Omitting the global factor e~^ F ° in Eq. (|30[) which is irrelevant for our purposes, the partition function can be 
formally rewritten as, 



M-l 



Z({O l ,X l }) = O + Oi]Jx k , 



with 



i=i k=i 



O t = e^ hY '. 



The exponential distribution of AF^ given in Eq 

Pk (x k ) = x k k ~ 



implies power law distribution of X k 



1. -r 1 t T 



T 



T c {h) T c {h) 



T c (h) 



\ogX k + 



T 



T c {h) 



(42) 



(43) 



(44) 



defined in the range < Xf. < 1. Now the sample average of the p-th moment of fc-th thermal cumulant given by 
Eq. ([4"T]) can be expressed as, 



[<(YKl(Y)' 



PL 



'M-\ 



P1+P2 



'M-X 



1=0 



dO lr 



\nZ({O lr ,X,}) J] E Yl ° lr 



r=p! + l 



1=0 



dO lr 



\nZ{{Oi r ,X,}) 



o=i. 



(45) 



Let us emphasize that a M-th level model, which only takes into account the lowest M levels, gives correct results 
of the moments up to order 0(T/T c ) M . We report the proof in appendix IC 11 This justifies the use the simple 
two- level model discussed in the previous subsection IIV Al at low enough temperatures and guarantees that correction 
terms at high orders in T/T c (h), if needed, can be obtained systemacially by considering 3,4, ..-level models. 
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Now let us examine explicitely a few moments of K2(Y) and n^,(Y) which are related to the linear xi = (3k2(Y) an d 
the 1st non- linear susceptibilities % 2 — P 2 /2!k 3 (1"). The details of the computation are reported in appendix [Q and 
we quote the results below. 

For the linear susceptibility, we obtain by using a 3-level model, 

M y)] = (ViVA«,)*{^ + 0(^| J (46) 



H(y)] = (Vlvi.„)*|^ y + o(^ y ) }. ,47) 

These results demonstrates that the linear susceptibility is not self-averaging, i.e. [xf\ (IxJ) 2 as expected. In 
sec. IIV Al we have argued that probability to have a rare sample which happens to have a critical held h c close enough 
to a given h is 0(T/T c (h) Eq. ([37| . Indeed in the above results we see that both the 1st and 2nd moment of the 2nd 
thermal cumulant are proportional to T/T c (h) and agree with the expected scaling form Eq. (J35J). 

The sample average of the 1st moment of the 3rd thermal cumulant is zero |[t3(X)| = simply due to the symmetry 
reason. (We again remind the readers that we are actually studying the fluctuations of the transverse variable Y.) 
However its 2nd moment [k§(X)] is non-zero. Following the same steps as before we find after a lengthy algebra, 

[«|(F)] = (Vwa.,) 6 ^-(^y + O^) 3 }. (48, 

The result means that the non-linear susceptibility X2 is strongly non-self averaging. The result agrees again with the 
expected scaling Eq. (|39p at low enough temperatures T <C T c (h). A remarkable feature is that it is super extensive, 



(49) 

which diverges in the thermodynamic limit N oo. Thus the non- linear susceptibility can be divergingly large either 
positively or negatively in a given sample. This is an ambiguous signature of anomaly the associated with step-wise 
responses which is invisible in thermodynamic susceptibilities. 



C. Distribution of mesoscopic responses in the zero temperature limit 



Here we take a different route to study the mesoscopic response by taking the zero temperature limit T — > first. 
As noted in III C 21 in this limit h w — * 0, meaning that the steps become maximally sharp, so that the FDT approach 
cannot be invoked anymore. While the FDT approach is limitted to desribe response only within the scale of single 
steps, here we will find that we can actually go beyond this limit. 

For each sample, we consider response at T = induced by the field increased from h to h + Sh with Sh > 0. At the 
beginning the system stays at the ground state under h. By increasing the field by Sh there may be level crossings 
by which the variable Y jump abruptly. Thus at T = the induced response can be written simply as 

ip = Y{h + Sh) - Y(h) (50) 

where Y{h) is the value of the Y variable of the ground state at h and Y(h + 5h) is that under h + Sh. We are 
especially interested in the distribution function of the induced response Eq. ([5H)l over different realizations of the 
samples, 

p(5h, 1>) ee pty - (Y(h + Sh) - Y(h)))] . (51) 

Fortunately we have complete information of the low lying states: Yj (more precisely Yi ) follows the Gaussian distri- 
bution given by Eq. (f2"g)) and the free-energy difference AFi ym between l-th and m-th states follow the distributions 
discussed in sec. IIII B II 
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FIG. 7: (Left) Level crossing in the two-level system. In the case 1) Y\ > Yo the two levels do not make a level crossing for 
ft > so that there are no induced response ip = 0. On the other hand for the case 2) Y\ < Yo the two levels make a level 
crossing by which a step of the response ip = Yi — Yq is induced. (Right): Level crossing in the three-level systems. The cases 
l)-4) are already included in the two-level model (See Fig. [7J). In the cases 5),6-a) and 6-b), the third level comes into play in 
the last stages represented by thick arrows. 



1. Two-level model 



Let us start from the two-level model. First we note that the case 1) Y\ > Yo and 2) Y% < Yo must be distinguished. 
As shown in Fig. [7] there are no level crossing and thus no response in the case 1) for Sh > 0. In the case 2) the 
response remains zero ip = until the applied field reaches a critical field, 

h c =^§ 
Yi-Yo 

at which the free-energy level of the two states become the same and then jumps to ip = Y± — Yo. The distribution of 
the response ip may be decomposed 

p 2 ~ leve \iP, Sh) = ^- level (V, Sh) +p?- level (^, Sh) (52) 

where po{ip) is the contribution from the cases that the ground state remains to be '0' and p\{ip) is the case that it 
is shifted to T'. One can easily find (see appendix [Dj, 



pV™USh) = 8&) { 1 / #' - e-^') \ pV^USh) = e JTl_ (l - e-^). 

(53) 

If we take N — > oo limit with fixed Sh in Eq. ([5^]) and Eq. (|5"3"|) . the distribution function reduces to a single delta 
function S(ip). On the other hand, the result also suggests us to consider the distribution of a scaled variable, 

$ = ^7 AY = VlVA cff (54) 
where AY is the scale of typical height of a step given in Eq. (|3"3"]) . Its distribution function reads as, 

j5 2 - lcvcl (^ Sh/h s ) = ^- lovol (^, Sh/h s ) + Pl- lcvcl ^, Sh/h s ) (55) 
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with 



p 2 - l ™ l $,Sh/h s ) = S(i>) 
Pl- ievei (ij,Sh/h s ) = 



n V47T 



where we find a natural scale of the field, 



K = 



NA 



(56) 



(57) 



Note that this is nothing but the scale of the typical spacing between steps given in Eq. (1341) . 
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FIG. 8: Plot of the distribution function P(tp) of the scaled response ip = ip/^/NA. Here contributions from the terms up to 
0(Sh/h 3 ) in Eq. (|56[) are displayed. For small fields Sh/h s <C 1, most of the sample remain intact by the presence of the field 
while rare samples of a fraction of order 0(8h/h B ) make large jumps of order yN A. 

A notable feature of Eq. (|56|) is that it is an analytic function of the scaled field 5h/h s . For sufficiently small field 
5h/h s <C 1, the terms up to 0{8h/h s ) will be sufficient. In Fig. [S] we display the distribution function using the terms 
up to 0(8h/h s ) in Eq. (f55"|) -Eq. (f56"| . We can understand the physical meaning of the profile as the following. The 
term pl~ level (5h/h s ,ip), which is 0(8h/h s ), represent rare samples which jump by very small field while the other 
term pQ~ level (5h/h Sl ?p) represent majority of the samples which remain intact by the presence of the field. Thus the 
distribution function describes the intermittency of the mesosocpic response. 



2. Three-level model 



Now we extend the analysis including the 3rd lowest state and consider a three-level model, which consists of the 
ground state 0, 1st excited state 1 and the 2nd excited state 2 under h. The pattern of level crossings can be classified 
into 3! = 6 cases depending on the ordering of Y"o, Yi an d Yi as shown in Fig. [7J In this model there can be at most 
2 level crossings within a given interval Sh while only 1 level crossing was allowed in the two-level model. 

Similarly to Eq. (|55p . it is natural to decompose the scaled probability distribution function as, 

p 3 - lcvcl (^, Sh/hs) = p^ lcvcl (^, Sh/h s ) + Pl~ lcvc \4>, Sh/h s ) + p 3 2 - lcvc \j, 6h/h s ) (58) 
where the 1st, 2nd and 3rd terms in r.h.s. corresponds to the cases that the ground state at h + 5h is at '0', T' and 
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'2' respectively. They are computed in the appendix [Dl The results read as, 



f - level $,Sh/h s 



~3— level 



~3-level 
Pi 



(4>,5h/h s ) = 



1 — e ft = v 



1 - 



p 3 2 - lcvc \i,,Sh/h 



1 — 2e h = v + e h = ^ 



V47T 
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1 - 2e~~ 
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, V2tt 
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47T 
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2tt 



«1 

-2X\ 



?2tt 



'x- 



: «KV--(Z2-Zl)) 



l(l-e-3^)-i(l-e-«) 
3 V ; 2 V ; 



f=^(^-(*2-*l)) 



(59) 



Comparing Eq. I|59p and Eq. (|56|) we find that following. First p2(ip,5h/h s ), which is absent in the 2-level model, 
is 0((5h/h s ) 2 ). Second, p {tp,Sh/h s ) and pi(ifj,5h/h s ) of the 3- level model agree with those of 2-level model up to 
0(Sh/h s ). The situation is reminiscent of the low temperature expansion where we found that M-level model give 
correct results up to 0((T /T C ) M - 1 ) as we prooved in section [UTl In the present context we do not have an equivalent 
proof but we believe that M-level model gives correct results up to 0((5h/h s ) ). By this way, we can go beyond 
the limit of single steps and access successive steps. 



3. Discussions 



The above results suggest that distribution of ths scaled variable ip follows a generic scaling form, 



PO, Sh/h s ) = Sty) 1 - / dV'-PjumpW, Sh/kn) + Pjump^, Sh/h B ) 



Pjumpii'^h/hs) = ^ 



n=l 



5h 



fni-ip) for Sh/h s < 1 



(60) 



The term Pj U mp('0j Sh/h s ) represent contributions of the samples in which the ground state changes responding to the 
field. We expect correct value of the coefficient /„ will be obtained by considering n + 1-level model, which can take 
into account possible n successive jumps in a given internal 8h. We expect that the qualitative feature is explained 
well by Fig. [5] and higher order terms of Sh/h s give only mild modifications without changing very much the shape of 
the distribution function. 

The distribution function of the response is a smooth function of the scaled field Sh/h s in spite of the fact that the 
underlying responses in each sample are highly non-linear processes. It must be contrasted with the expansion of the 
response itself in a given sample in power series of Sh/h w (See Eq. (|3ip ). The static FDT relies on the latter kind of 
expansion and thus it can not be applied beyond the scale of a single step h s . On the other hand, it must be noted 
that the power series of 8h/h s will converge only for sufficiently small 5h/h s . Since h s given in Eq. (|57|) (or Eq. (|3~H) ') 
vanishes in the thermodynamic limit N — > oo, the new power series also describes not macroscopic but mesoscpic 
responses. 

Let us call the regime Sh <C h a , where the expansion converges, as weakly perturbed regime, and the other regime 
5h 3> h s as strongly perturbed regime following [471 ]. 

• An important generic feature in the weakly perturbed regime is that even with such a small field 6h <C h s , where 
most of the samples do not respond at all, there are a fraction of 'fragile' samples of order 5h/h s which are able 
to respond strongly chaging its own ground state. Although they are rare, they dominate average behaviours. 
This means, static chaos effect does not appear all of a sudden at certain large sizes (or strong enough field) but 
appear strongly on rare samples even at small sizes (or weak field) and thus appear gradually in the averaged 
quantities. The weakly perturbed regime is examined numerically in detail in the static chaos problems of 
directed polymer in random media in [47| . Rece ntly it was also examined in detail in a study of bond-chaos 
effect in the Edwards- Anderson spin-glass model [48| . The weakly perturbed reg ime is also proposed to explain 
some features observed in temperature-shift experiments on spin-glasses [5lL |52| . 
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• In the strongly perturbed regime 5h^> h s , where most of the samples will respond, we still expect the distribution 
function of the repsonse ip follows the generic scaling form as Eq. (|60[) but with a different functional form, 

expf- ^-^-H 

P(4>,5h/h s ) i = J - for 5h/h s ->\ (61) 

V47T 

which means 

in terms of the original unsealed variable t/> = Y(h + Sh) — Y(h). 

The reason for the above functional form is the following. Since there will be large number of steps 5h/h s ~ 
0(y/N) ^> 1 witin a fixed interval Sh, each step with an increment of order AY ~ A e g(h)y/N, the total 
response within Sh will be 0(N). This is consistent with the fact that the response must be extensive in the 
thermodynamic sense. Since the total response is the sum of sue a large number of steps, we expect its sample-to- 
sample fluctuation follows the Gaussiandistribution due to the central limit theorem. From the thermodynamic 
calcinations we know that 



\A cS {h)) 2 5h 
T c (h) 



\wi = m h+Sh p-i = N z ,:i (63) 



as given in Eq. (jBlpp . Since there will be for sure some steps in the strongly perturbed regime, Y varianle of 
the ground state at h and that at h + Sh must be uncorrelated. Thus the squared-variance of ip will be just 
the sum of those at h and h + Sh, which amounts to 2NA c g (h) 2 . In short, in the strongly perturbed regime 
we observe thermodynamic response which is self-averaging, while in the weakly perturbed regime, we observer 
mesoscopic response which is non-self averaging. 

Lastly it is interesting to note that average response, obtained in the weakly perturbed regime, matches precisely 
with that in the strongly perturbed regime Eq. (|63[) . From Eq. (|55p ~Eq. (|56p we find 

which means, 



\m= V ^0 -J (64) 



,M? +0 ff] . (65) 



T c (h) \h 

This agrees with the average in the strongly perturbed regime Eq. (f6"5)) . Both are linear in Sh so that they yeild 
the same linear susceptibility. This coincidence is consistent with the expectation that disorder-average of the linear 
susceptibility and 1st derivative of thermodynamic response should agree (See appendix fX]). 



D. Cusp in the overlap 



Finally we analyze the overlap function, given by Eq. (fTl)) . between two replicas subjected to slightly differnt fields 
which reads as, 



C(Sh) 



\[(Y(h + Sh)) (Y(h-Sh))} 



'X(h)Y 



(66) 



1. FDT approach 



Let us consider a Taylor expansion of the correlation function (Y(h + Sh)) (Y(h — Sh)) in power series of Sh, 

(Y(h + Sh)) (Y(h - Sh)) = ( Kl (Y)) 2 - (pSh) 2 (( K2 (Y)) 2 - k 3 (Y) Ki (Y)) + O(pSh) 4 (67) 
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energy <Y(h- §h) Y(h+ §h)> 




FIG. 9: Level crossing and decay of the overlap between 2-replicas subjected to h — Sh and h + Sh. Here an example of the 
case Yq > Yi > is shown. 



Note that terms of odd powers of Sh are absent smiply due to the symmetry of the correlation function under 
Sh <-> — Sh. 

We have obtained n\{Y) up to 0(T/T c ) 3 as Eq. (|T7| . To the same order we find, 

t«?(F)] = (AViV) 2 |l - L + o 1 = -(A^) 4 1 1 - + O j (68) 

as reported in Appendix [Cl Combining these results we obtain, 

where h w = T/(AyN) as given by Eq. |5j). As shown in Fig. [TOl the series Eq. (|69|) describes the thermally rounded 
region of the correlation function around Sh ~ 0. 

We know that the thermal cumulants which appear Eq. (|67p are non-self averaging. Thus the overlap must be 
non-self averaging as well. 



2. Zero temperature limit 



Now we turn to the case of zero temperature limit where the FDT approach breaks down since h w — > 0. For 
simplicity we only consider the 2-level model. As sohwn in Fig. [9l the overlap between the two replicas remains Y 2 
in the range < \Sh\ < h c and becomes loYi at \Sh\ > Sh c . The critical field is given by 8h c — AF/(Yo — Yi). 

Considering the cases Yq > Yi and Y\ > Yq, we obtain 



Hm \[(Y(h - Sh)Y(h + Sh))]\ 



dY / dY 1 P(Y )P(Y 1 ) 



Y 2 



NA 



Sh 



dY 1 P(Y )P(Y 1 ) 



Y k 



dy 



dAFp(AF) + Y Y 1 

\8h\iYi-Ya) 

\Sh\(Y -Yi) 



\6h\(Yi-Y Q ) 



dAFp(AF) 



\6h\(Y -Yi) 



dAFp(AF) + Y Yi 



dAFp(AF) 



=yo(yo - yi) 2 



dy 

V2n 



dy 



=y {yo - yi)' 

2ir 



O 



Sh 



from which we find, 



lim C(Sh) = 1 



0r h 



\ h s 



(71) 



A remarkable feature of the correlation function at T = is that it exhibits a cus singurality at Sh — 0. In Fig. [5] it 
is evident that the cusp is strongly non-self averaging. The linear \Sh\ profile is due to the presence of rare samples 
which have critical fields Sh c close to Sh = 0. 



(70) 
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FIG. 10: The profile of the overlap function. It exhibits a cusp at T = 0, which is rounded at finite temperatures. The doted 
line is Eq. (|7ip obtained at zero temperature with the two-level model, which correctly captures the feature around the top of 
the cusp. The solid line is the result obtained by the replica method at T = which yeilds the full profile. (See sec. IV CI ) 
The dashed line is the curve at T/T c = 0.1 Eq. (|69|l obtained by the FDT approach (using the 2-level model), which describes 
thermally rounded region of wdith ft w around the center. 



V. REPLICA APPROACH 



In this section we analyze the mesoscopic responses by a replica approach. This complements the low temperature 
exapnsion approach discussed in the previous section. We construct a generating functional from which various 
correlation functions associated with the mesoscopic responses can be computed exactly. 



A. Generating functional 



To analyze statistical properties of mesoscopic static responses it is useful to consider the following object: 

omF wk^ ' ' ' WM) • ■ • (- (72) 

with fci > 1, k-2 > l,...,k p > 1. Here F(Sh) is the free-energy of a system sujected to a small probing field 6h. 
The derivatives with respect to the probing fields yeild disorder averages of various kinds of correlation functions 
of our interests. Using the replica formalism the product of the free-energies \[F(8hi)F(SIi2) . ■ ■ F(5h p )]\ in the above 
expression can be replaced by 

lim Z n * (5hi)Z n * (Shi) ■ ■ ■ Z n '(Sh p ) (73) 

m,Ti2,—,np— >-0 n\Tl2 • • • n p 

where Z(8h) is the partition function of the system. Thus we need to consider real replicas r = 1, 2, . . . , p which are 
subjected to different probing fields Shi, Sh2, ■ • ■ , Sh p and replicated further into m, n-z, . . . , n r replicas. 



p-spin Ising model and REM 



To be specifiCjlet us consider the j3-spin Ising mean-field spin-glass model [25|, HiJ given Eq. J!} . Following the 
standard steps [441 ] we obtain the replicated partition function of n-replicas, 



\\Z n ]\ = Tr„ 



s nJV(/3J) 2 /4 



UdQ ab [ 'jJ^ e -"G({g. 6 MA.»}) 



a<b 



a<b 



27T 



(74) 
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1 2 3 4 5 



FIG. 11: A schematic representation of an 1 step RSB ansatz. n replicas ('atoms') are grouped in n/m clusters ('molecules') 
of size m. Different clusters occupy different metastable states i. 
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FIG. 12: Parisi's matrix / for a 1 step RSB solution of size n x n. The size of the blocks are m x m. Different solutions, 
corresponding to different grouping of the atoms in Fig. 1111 are obtained by permutations of the lows and columns. 



where 

\2 



G({Q ab , X ab }) = ]T Q p ab + \ £ KbQab - lnTi V e £ (75) 



4 ^^ a0 2 

a^b a^b 



with 



£ = ^^2\abVaVb + ^2f3(h + 6h a )a a (76) 

a^b a 

Here X a b are Lagrangian multipliers introduced to define the overlap, 

1 N 

i=l 

The integrals over Q ab and X a b are evaluated using the saddle point method. 

Note that we have added small perturbing field 8h a applied on each replica in addition to the uniform external field 
h. We suppose that the perturbing fields are infenitesimally small such that they do not change the saddle point itself. 

Now we consider a particular 1 step RSB saddle point in which the n replicas are groupd into clusters C — 
1,2,..., n/m of size m. (see Fig. [TTJ) The parameter m is known to depend on the temperature as (See Eq. (|B20|) 
for the case of the REM), 

m =m- (78) 

For such a saddle point the n x n matricies Q ab and X ab can be put into block-diagonal forms with block size m (see 
Fig. [T2|) . We denote the matrix elements in the block diagonal parts as gi,Ai and the others as go and Aq. Then one 
obtains for sufficiently small n, 

x r n/m r 

lnTi V e £ = - ? iy + / Dzo^ln / D Zlc J](2coshS(/i + 8h a )) (79) 

J C = l ■* a£C 
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with J Dz 



I- 



° dz c ~ z /2 



and 



3(ft) = + V^o^o + vAi - A 2ic- 
Making an exansion about the perturbing field <5/i a , we obtain 

(/3^a) 2 



In Tr ff e £ = (In Tr (T e £ )^ =0 + [i £ /^a + T X EA £ ■ 



A 2 



J] J2 PShaPShb + 0(6h) 3 



a=l 



a=l 



C=l a£C,b£C 



with 



and 



J D Zl cosh m (/i) tanhS(/i) 



EA 



(Aeff) 



JD Z1 cosh"» 

/D„ cosh m (h) tanh 2 S(h) 



D 2 



/£>„ cosh m (/i)tanhH(/i) V 
/A* cosh m (/i) J 



f£> Zl cosh m (/i) 



JD Z1 cosh m (/i) tanhS(fc) 
cosh m (/i) 



(80) 



(81) 



(82) 



(83) 



The replicated parition function Eq. (|74[) contains contributions from other 1 step RSB solutions obtained by 
permutations of replicas. One must also integrate over fluctuations around saddle points. Then the replicated 
partition function is obtained as, 



|[Z»]| = c^exp 



SP 



N[ij2P 5h « + NT x EA J2 



((35h a y , (VNA cfi ) 



J2 P$h a p5hf3 + O(Sh) 2 



c=i 



,/3ec 



(84) 



where X)sp stands for summation over all possible permutations of replicas, i.e. different ways of grouping the n 
replicas into n/m clusters of size m. The factor c stands for a common factor which does not depend on the probing 
field Sh's. Then for the case that we have p replicas (See Eq. (f73|) ) we obtain the following expression, 



[Z?Z?...ZF]= c^exp 



SP 



(/36ha¥ 



a=l 

v . (r,n r ) (s,n.) 



a=l 
\2 P 



(85) 



r,s — 1 



Here we have p groups of replicas. We labeled the groups as r = 1, 2 
we labeled as (r, 1), (r, 2), . . . , (r, n r ). The total number of replicas is 



0(Shf 

/9=(r,l) /3=(a,l) 

p. r-th group consists of n r replicas which 



"tot 



r=l 



(86) 



Let us explain the physical meaning of the terms in the argument of the exponential function in Eq. (|85j) . 

• It is easy to veryfy that the parameter /i for the terms at order 0(Sh) represents the expectation value of the 
magnetization /i = \[(a)]\. 

• We have devided the O(Sh) 2 terms into two parts: one which involves single replicas and the other which 
envolves pairs of replicas. Physically we understand the former as due to intra-state response and the latter as 
due to inter-state response. As is well known, in the limit p — > oo the p-spin model reduces to the REM (25l . [44| 
in which the intra-state linear-suscepibility xea is zero by construction of the model. 

Here let us note that the evaluations of the 0(Sh) 2 terms must be done carefully. Actually the expressions for 
the parameters xea and A D g Eq. I|82p and Eq. (j53")) are valid only for zero external field h — 0. This is because for 
h 7^ 0, the magnetization \x is non-zero so that integrations over fluctuations around the saddle points yield additional 
0(5h) 2 terms. Such calcurations are very difficult to perform in general. An exception is the case of REM (p — * oo 
limit) in which we only need to consider fluctuation of the size of the clusters m in the 1 step RSB solutions, as we 
report in appendix [Gl 

For the rest of the present section we consider the case of REM p — > oo which allows us to neglect intra-state 
responses. As we noted in section Hi B[ REM can be regarded as an effective model for a generic 1 step RSB systems. 
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B. Sample-to-sample fluctuations of linear and non-linear susceptibilities 



We now analyze the statistics of the susceptibilities using the replica approach to confirm the results obtained by 
the low temperature expansion approach in sec. IfVBI As we show below we obtain presumably exact results for the 
sample average of the p-th moment of the thermal cumulants \ni p k (Y)}\ given by Eq. (|¥Tj) . Interestingly the results are 
expressed in power series of the parameter m = T/T c (h) (sed Eq. ([78)) ') which can actually be viewed as expansions 
in power series of T, i.e. low temperature expansion. 

Sample- aver age of p-th moment of the thermal cumulant Kk(Y) given by Eq. (|41| can be computed as, 



lim 



d k 



Qk 



rn,n a ,...,n l ,-o <9(/?<5/ii) fe d(f35h 2 ) k d{(35h p ) k 

-{VNA ) kp lim 1 d k 8 k 8 k 

° rai,ri2,...,np->o nin 2 ■ ■ ■ n p dx\ dx\ dx k 

where we introduced a scaled variable x r defined as 

PSh r 



n\n 2 ■ ■ ■ n 



exp 



Sh=0 
1 P 

— ^ x r x s A rs 



x=0> SP 



icir 



N 



5h r 



(87) 



(88) 



with h w given in Eq. §5§ and 



(r,n r ) (s,n s ) 



(89) 



and the bracket (. . .) SP means to take an average over all possible partitions of n to t replicas into nt t/m clusters of 
size m. 

Let us begin from the linear susceptibility. As in the approach by the low temperature expansion we study 1st and 
2nd moment of the 2nd thermal cumulant K2(Y). Using the prescription Eq. ([87]) for the sample- average of the 1st 
moment of the 2nd thermal cumulant K2(Y) we find, 



\MY)]\=(N(A cS f) lun -(A) SP 

n^O n 



where 



.4 



a,f3 



(90) 



(91) 



We now need to evaluate (<5i Q ,i /j ) SP f° r a — P which is the probability that two distinct replicas belong to a common 
cluster. It is evaluated as, 



(n/m) ■ m(m — 1) ■ (n — 2)! m — 1 



1 



Here the denominator n\ is the total number of solutions and the numerator is the number of solutions in which two 
distinct replicas belong to a common cluster. The first factor n/m in the numerator is the number of ways to choose a 
cluster among n/m clusters. The 2nd factor m(m — 1) is the number of ways to choose two replicas out of m replicas 
belonging to the cluster. The last factor (n — 2)! is the number of ways to put the rest of replicas in the remaining 
n — 2 seats. Then we obtain 



i(n - 1) (5i a ,i l3 ) S p = n(m - 1) 



SP 



Using the above results we finally obtain a very simple result, 



|[k 2 (Y)]= (VF(Aeff)) 2 m. 



(92) 
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Since m — T/T c (h) as given in Eq. (|78[). this result agrees with that obtained by the low temperature expansion given 
by Eq. (|4"B"|) obtained in sec lIVBl There we have found that 0(T 2 ) term is zero. The above result means that actually 
all higher order terms are zero. 

Next let us evaluate the sample-average of the 2nd moment of the 2nd thermal cumulant k 2 (Y). Using Eq. (|57|) we 
find, 

[4(Y)} = (N(A cS ) 2 ) 2 lim -±-(2 (A 2 12 ) sp + (A n A 22 ) SP ). (93) 

We report the details of the computations in appendix [E] Here we only quote the result, 

[4(Y)] = (^(A cff )) 4 m, (94) 

which again agree with the result obtained by the low temperature expansion given by Eq. (|47|) . In sec IIV Bl we have 
found that 0{T 2 ) term is zero. The above result means again that actually all higher order terms are zero. 

Last let us study the non- linear susceptibility \i ■ As in the approach by the low temperature expansion we analyze 
the 2nd moment of the 3rd thermal cumulant ^(Y). We report the details of the computations in appendix lEl The 
result reads as, 

[k 2 (Y)} = (%/7V(A cff )) 6 lim — ^(9 (A 11 A 12 A 22 ) SP + (A 3 12 ) ) = (V^(A cff )) 6 2m(l - m), (95) 

J rii,n 2 -+0 n\n 2 ° r 

which agrees with Eq. {48]). 



C. Cusp in the overlap 

Finally let us study the overlap Eq. (TTJJ between two real replicas, T' and '2', subjected to slightly different fields 
ho + Shi and/io + Sh 2 by the replica approach. As we discussed using the low temperature exapnsion approach in sec 
IIVD1 the correlation between the two real replicas, 



(Y(h + Sh 1 )Y(h + 5h 2 )) = Q{ g h T d{fih s log Z{h x ) log Z(fta)] 



(96) 

h\=ho+f>h\ ,h 2 =h +Sh2 



should strongly fluctuate from sample-to-sample. Using the replica method its sample average can be expressed 
formally as, 



\[(Y(h + 5h 1 )Y(h + Sh 2 ))}\ = — d " lim J- [Z* {h x )Z n * {h 2 )]\ 

0{phi)0(ph2) rai,"2->0 n\U2 



hi=ho+Shi ,h2=h a +Sh 2 



q 2 A I /MA ^2 2 (l,n/2) (2,n/2) \ 

VM ; V ' SP \ r,s=l a=(l,l) /3=(2,1) / 

In the last equation X)sp stands for the summation over all 1RSB solutions. For simplicity we chose n\ — n 2 = n/2 
which will not change the result. 

As in our previous analysis based on the low temperature expansion, here we can again analyze the correlation 
function in two ways 1) FDT approach and 2) T — ► limit approach. 

For the 1) FDT approah it is useful to rewrite Eq. (|97|) rescaling the fields by the width of the steps h w = T/yNA e g 
as we did in Eq. ((88]) ; 

[(¥(}«> + 6h 1 )Y(h + 6h 2 ))j = d 2 4_ ^ (l_ 2 SKSK (1 ^ 2) (2 ^ 2) \ 

On the other hand, for 2) T — > approach we may rewrite it rescaling the fields by the spacing between the steps 
h s = T c {h )/VNA eS , 



Hm (Yiho + dh^Yjho + Sh^) = ^ d 2 



A I 1 2 XL XU ihn/2) (2 '" /2) \ 

v 4 2 / 1 ° h r 0h s ^ \ - I 

— ) SP \ r,«=l a=(l,l) /3=(2,1) / 



T^O (^NA cfi (h )) 2 m^O q (§h±^ g f8h 

(99) 

Here we used m = T/T c (h Q ) given by Eq. ([75)1 . 
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1. FDT approach 

In the FDT approach we exapnd Eq. (|98|) in power series of 5hi/h w and 5ti2/h w around Shi/h w = 5Ji2/h w = 0. 
We find for the case Shi = —Sh^ = —Sh, 

\[(Y(h - 6h)Y(h + Sh))}\ _ [k*(Y)] (5h\ 2 [4(Y)] - \[k 3 (Y) Ki (Y)}\ | q ( Sh" 4 



NA eS (ho)) 2 (^NA cS (h )) 2 \h w J (VNA cS (ho)) 4 \ h 

(1 - m) - m(2 - m) ( ^) + O ( ^) (100) 



\h w J \h 

using [4{T)} = (VNA cS (h)) 4 m given in Eq. (HI, [k 2 {Y)] = (VNA cS ) 2 {l - m) and \[k 3 (Y) Ki (Y)}\ = 
— (v^VAoff ) 4 to(1 — to) reported in appendix [El Thus we find the overlap function Eq. (|14j) as, 



Indeed the result agrees with that by the low temperature expansion appraoch given in Eq. ([6^ 



2. Zero temperature limit 

Techincal difficulty with the 2) T — > approah is that we have to express the result of the summation over all 
1RSB solutions X)sp m a c l° se d analytic form so that we can take the m — > limit analytically [6l|. We report the 
calucrations in appendix [Fl The results reads, 




(102) 



with I = 2Sh/h s . Thus the overlap function exhibists a cusp as shown in Fig. [TO]hi agreement with the result obtained 
by the low temperature exapnsion approach. 

To derive the above result in appendix [Fj we used the approach of [13, HH which study statistical properties of 
turbulant flows obeying the Burgers equation. In the next section we discuss the intriguing connection between the 
intermittency in the turbulant flows and step-wise responses in mesoscopic glassy systems. 



VI. MAPPING TO A PINNED ELASTIC MANIFOLD PROBLEM AND A TURBULENCE PRPBLEM 



In this section we discuss the connecton between the present problem of mesoscopic responses in glassy systems, 
the problem of jerky effective energy landscape of pinned elastic manifolds [30| and intermittency in turbulent flows 
due to shocks [3l|, H2, . 

Let us consider a simple pinned elastic manifold problem, namely a particle on a one dimensional space connected 
to a Hookian spring and subjected to a radom potential [42j. The partitoin function and the Hamiltonian is defined 

as, 

Z{Y )=r dY --Pum) U(Y,Y ) = ^(Y-Y ) 2 +F(Y). (103) 

One end of the Hookian spring of spring constant n is connected to the particle at Y and the other end is fixed at Y . 
F(Y) is a random potential whose values are drawn from a Gaussian distribution with zero mean and a short-ranged 
spatial correlation, 



\[F(Y)F(Y')] = Nc(\Y-Y'\). 



(104) 
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Here c(y) is a certain rapidly decaying function. Comparing with the random energy model given by Eq. (|15p with 
the simplest generalized complexity of the form Eq. (fTT|) , we find the two models are related as, 

• The extensive variable Y becomes a coordinate of an one-dimensional space. 

• The Gaussian distribution of the Y variables over differnt metastable states with variance AyN amounts to an 
effective entropic spring force with spring constant, 

(105) 



aVn 



• The random (free) energy F at different metastable states amounts to a random potential F(Y) with short- 
ranged correlation. 



• The external field h is equivalent to, 



Y = -. (106) 



The effective force that the system yeilds can be defined as, 

f<Yo) = -T™^=K(<y)-Y ) (107) 

By moving the end point Yq of the spring, the position of the particle (Y) in equilibrium changes elastically up to 
a certain point beyond which it exibit a sudden jump to a different energy minimum. Such a process was studied in 
detail by Bouchaud and Mezard 33]. The jump is of couse rounded at finite temperatures. This is what corresponds 
to the step-wise response we have discussed so far in the present paper. At such a jump, the effective force /(Yq) 
also changes discontnuously. Thus the effective energy landscape — T\tlZ(Yq) consists of parabolic wells matching 
with each other at singular poionts where the effective force (slope) is discontinuous. Note that the overlap function 
Eq. (fTi)) we studied, which exhibit the same cusp as shown in Fig. [TU1 corresponds to the correlation function of the 
effective force |[/(0)/(F )]|- 

As pointed out by Bouchaud and Mezard [33], the toy model Eq. (| 1 03[) can be mapped to a yet another problem 
of a one dimensional tubulent flow. By the so called Cole-Hopf transformation, 

we obtain the Burgers equatrion for the velocity field v(Yo,t) at time t, 

dv dv d 2 v ,_ nnS 

n +v wr v 9Yi (109) 

where rj is understood as the viscosity of the fluid. The initial condition at time t — specified by, 

»«,»> = ?|f>, (110) 

so that the velocity field is completely randon at t = 0. 

The velocity field v(Y, t) changes discontinuously at certain points in the space, namely shocks. The intermittency of 
the flow due to the presence of the shock is manifested in the velocity- velocity correlation function, which corresponds 
to the overlap function Eq. (fT4|) in our probelm, as the cusp-like simgularity shown in Fig, [TUl To observe well defined 
shocks (steps) one need to consider fluid of high enough viscosity rj (low enough temperature T) . The spacing between 
the shocks (spacing between the steps h s ) decreases as the time t (system size N) increases. 

The toy model Eq. (|103p is the simplest dimensional version of the broad class of systems called elastic mani/olds 
in random media. The cusp like singularity of the force-force correlation function is predicted for such a broad class 
of systems by a mean-field theoretical approach based on the replica method and also by a functional renormalization 
group approach [30l ] . The thermally rounded region of width h w around the top of a cusp in called thermal boundary 
layer fill ]. Indeed the cusp is confirmed by a recent extensive numerical study These problems can be mapped 
to turbulent flows under continous random forcing (32| . 
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VII. CONCLUSIONS 



In the present paper we studied the statistical properties of mesoscopic responses in glassy systems from a mean- 
field theoretical point of view. More specifically we have studied a generic class on mean field models which exhibit 
I step replica symmetry breaking. We conclude that the mesoscopic response consistes of step-wise responses with 
typical height ^/NA c s, spacing h s ~ T c (h) / (y/~N A e g) and width h w ~ T / (y/N A e s) . This conclusion follows from 
observations of the mesosocpic response in two different ways. One is based on the FDT: we studied statistic of sample- 
to-sample fluctuations of the linear and non-linear susceptibilities related to the spontaneous thermal fluctuations. 
The latters are significant only in narrow regions of width h w around steps so that the averages of their moments 
are dictated by contributions from such rare regions. Our result proves the intuitions developed by the pioneering 
works in the SK model a long time ago (20L l2ll ] . We conclude that the FDT approach amounts to describe mesosocpic 
responses under variation of the external field Sh by power series of Sh/h w . In the second approach we did not rely 
on the FDT. Working directly at T = we obtained series expansions of the mesoscopic response in power series of 
5h/h s going beyond the scale of single steps. The presence of mesoscopic response means that the thermodynamic 
limit TV — > 00 and Sh — > limit do not commute: one observs thermodynamic susceptibilities by lhngh—>o limjv— >oo 
and mesoscopic responses by lrnijv^oo lim^^o . Furthermore, the presence of the two expansions Sh/h w and 5h/h s 
means the two limits limT — ► and lim Sh — > do not commute either. The the non-commutativities of the limits 
reflect the step (or cusp) singularity at mesoscopic scales. 

We note that a techincal challenge remains to evaluate the parameter A e g for a given perturbation from a given 
microscopic Hamiltonian. It quantifies the strength of a given perturbation. Since it conceres with the inter-state 
responses, one must find ways to disentangle intra-state and inter-state responses in a given response. For example, 
for the p-spin Ising model discussed at the begining of sec. [Vj we could evaluate A e g for general p only under zero 
field. For non-zero field, we could evaluate it in the p —* 00 limit by considering the fluctuaion of the size of clusters 
m of the 1 step RSB solutions as explained in Appendix. [G]but remains as a challenge for p < 00. 

Many features we obtained in the present paper can be rephrased by Imry-Ma type scaling argument, for instance 
the droplet theory for spin-glasses [13| and directed polymer in random media [14[ proposed by Fisher and Huse, as 
we noted from time to time in the present paper. In short, a low energy excitation of a mesoscopic scale L behaves 
much as a sample of a mean field model of size N. In finite dimensions, not only thermodynamic responses but also 
susceptibilities related to spontaneous thermal fluctuations via static FDT should become self-averaging thanks to 
the central limit theorem: independent mesoscopic excitations scattered over a given macroscopic sample contribute 
simultaneously and independently from each other to the total susceptibility. However it is of great interest to 
understand better properties at mesoscopic scales such as statistics of droplet-to-droplet fluctuations of the droplet 
excitations. We expect that our mean- field approach may be useful to obtain meanf field approximations of such kind 
of statistical properties. 

In Imry-Ma type arguments one can incorporate some refined knowledge of realistic low dimensional systems 
obtained by other means. For example, our results can be refined by the following adjustments. First the characteristic 
energy scale T c may be replace by T(L/Lq) 9 where Lq is a certain unit length scale, T is the stiffness constant and 
6 > is the stiffness exponent. Then the variance of the random variable Y may be generalized as A(L/Lo) a with 
a > replacing the simple Ay/N scaling. Then one finds h w ~ (T/A)(L/L )- a , h s ~ (T / 'A)(L / X )~ c where < = a-9 
is the so called chaos exponent [I3,[T3|. If the chaos exponent is positive C, > 0, the spacing between the steps vanishes 
in the limit L — > 00 leading to static chaos. An interesting consequence is that the thermal width h w vanishes faster 
than the spacing h s as L — ► 00 since 8 > 0. It will be very interesting to develop futher the replica approach in order 
to verify these points theoretically. 

APPENDIX A: ON THE MESOSCOPIC AND MACROSCOPIC LINEAR-SUSCEPTIBILITY 

For a given sample, say J, of a finite size N we can write, 



where we put the subscript J in order to remind us that it is associated with a single sample J. The differential 
susceptibility which appears on the r. h. s. can be identified with the correlation function through the static FDT, 




(Al) 



dyj(h) 
dh 



WAV) - (yj(h)) 2 ). 



(A2) 
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Taking average over different realizations of samples of both sides of Eq. (|A1[) we obtain, 



hAh)] 



[ dh' 


\dyj(h')] 


'o 


dh' 



or 



d\[yj(h)}\ 

dh 



dyj(h) 



dh 



(A3) 



On the other hand we have 



lim yj{h) = lim \[yj(h)}\ 

N— »oo N^oo 

since Yj = Nyj is a thermodynamic and thus self-averaging quantity. Thus we obtain 

|- lim yj(h) = lim \((yj(h)) - (y,j(h)) 2 ) 

Oil iv— >oo N— >oc I 



(A4) 



(A5) 



at any h. Thus 1st derivative of the thermodynamic response curve, say 'thermodynamic linear susceptibility' and 
sample-average of the linear susceptibility obtained via static FDT must coincide. Note that the above argument 
cannot be repeated for non-linear susceptibilities since linear-susceptibility may not be self-averaging, i.e. in general 
limjv^oo dyj (h)/dh ^ \[dyj(h)/dh]. 



APPENDIX B: AN EFFECTIVE REM 



We summarize below some basic properties of an effective REM with the simplest form of the generalized complexity 
given by Eq. (JT7J) 

E(/.¥) = c-£-^ (Bl) 

where c(> 0) is a constant which fixes the total number of states as, 

M = e Nc . (B2) 

The complexity can be cast into the form like Eq. (|2H)l as a function of the "total" free-energy f = f — hy and the 
transver variable y given by Eq. (|22|) . 



where we introduced a 'renormalized variance', 



A cff = - (B4) 



and new variables defined as, 



/ = f'y/1 - (hA cS ) 2 y = y + h(A cS ) 2 f. (B5) 

In Eq. (|B3[) it is evident that / and y are statistically independent from each other. In the present paper the variable 
like y which is statistically independent from the free-energy is called as transverse variable (see Eq. (|22pl. 
The shape of the generalized complexity close to the E = plane can be obtained by rewriting S as, 

N ^ = F>-(F>y(h) _^( F>- { Fr \ 2 (B6) 



T c (h) 2cN V T c (h) ) 2A^(A off ) 

Here F' = Nf, Y — Ny and (F 1 )* = -2cNT c (h) with T c being the critical temperatrure obtained below as Eq. (|B8j) . 
At large enough system sizes N the 2nd term on the r.h.s becomes negligible compared with the 1st term and the 
functional form of the generalized complexity converges to the expected generic form given by Eq. (|20p close to the 
£ = plane. Thus this effective REM should give generic results common in all 1 step RSB models concerning 
inter-state responses. 

It is straight forward to consider a slightly more generalized version of the complexity including also an off-diagonal 
term like —Kfj^ in Eq. (jBip . The latter represents a possible correlation between / and y of strength ~ K for small 
enough K. One can find again that the complexity can be cast into the quadratic form Eq. (|B3p . 
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1. Thermodynamics 



Now let us determine thermodynamic state (f*,y*) at a given temperature T and external field h. In Fig. [3l the 
variable / is held constant on the line C while the variable y is varied. Along C the complexity Eq. (|B3[) is maxized 
at the point P where y = 0. Thus we fined y* = 0. On the other hand /* is obtained through the condition Eq. (QI 
which reads as, 



1 
T 



-f Vl - (hAes) 



(B7) 



f=f,y=o 



and the value of the complexity at the saddle point (/*, y* = 0) is obtained as S* = c — (/*) 2 /2. 

The saddle point value of the complexity E* becomes when /* = —\f2c. Thus the critical temperature T c is 
obtained as, 



T c (h) 



y/1 - (hA cS ) 



jiU 



2c 



Here h dependence comes from the h dependence of (A e ff) given in Eq. (|B4 

In the glass phase T < T c the saddle point is fixed at (f*,y*) = (- 
density /' as 



(f'Y(h) = -2cT c (h) 



and the equilibrium value of the variable y as 



y*(h) 



A 2 



T c (h) 



(B8) 

2c, 0) . Then we find the total free-energy 

(B9) 

(BIO) 



using Eq. (|B5[) , Eq. (|B8[) and Eq. (|B4[) . Note that here A is the variance of the original Y variable. Taking a 
derivative of the last equation with respect to h taking into account the h dependence of T c (h) given by Eq. (|B8p one 
finds, 



X (h) = N 



dy*(h) = (A cff ) 2 
dh T c {h) 



(BH) 

where A e g is now the variance of Y given by Eq. (|B4p . 

Taking a derivative of the free-energy (/')* given in Eq. (|B9p with respect to the temperature one finds the well 
known result that the heat-capacity is zero below T c , 



C/N = 0. 



(B12) 



2. Replica approach 



Here we scketch the construction of the replica approach for this model. The partition function of a given sample 
is given by 



Z{T,h,5h) = J2 e ~ 



■PNViW-shvi) 



(B13) 



where i is the label for each metastable state. f'(h) = f — hy is the total free-energy density under external field h. 
The sum runs over all states whose number is M = e Nc as given in Eq. (IB2[) . We have also included infinitesimal 
probing field 5h coupled to the transverse variable y defined in Eq. (|B5[) which is statistically uncorrelated with the 
free-energy density /'. 

The distribution of the quenched random variables /' and y is specified by the generalized complexity given in 
Eq. (|B3"1) supplemented by the relation /' = \/2cT c (h)f which follows from Eq. (|B5|) and Eq. ([HH]> . We obtain 
sample-averaged replicated free-energy as 



M=e c 



\[z n ]\ 



E 



exp 



N{c{pT c {h)f 



{j35hf 



(Acs) 
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Let us summarize below the analysis of the thermodynamics following [25l . |33j which reproduces the results obtained 
above without using the replica approach. Here we switch off the probing field Sh — 0. Within the replica symmetric 
ansatz (RS), one assumes that n replicas occupy different states. Then one obtains 

\[Z n \ ~ exp [cNn{\ + (f3T c (h)) 2 }] (B15) 

from which one obtains the thermodynamic free-energy and entropy as 

- PF RS /N = lim ^— - = c{l + (PT c (h)) 2 } S RS /N = c{l - (f3T c (h)) 2 }. (B16) 
n— *o nl\ 

The entropy vanishes as T — > T c {h) suggesting condensation of the Boltzmann weight. Thus we find again that T c (h) 
given in Eq. (|B8j) is the critical temperature. 

Below T c (h) we expect the 1 step replica symmetry breaking (1 step RSB) ansatz gives physically correct saddle 
points [25L [33j |. ft amounts to assume that n replicas are grouped into n/m clusters of size m such that replicas 
belonging to a common cluster stay at the same state while those belonging to different clusters stay at different 
states. 

In Fig. [TT]we show a schematic picture of such a 1RSB solution. Note that there are many 1 step RSB solutions. 
Each solution is determined by 1) choosing n/m states to be occupied out of M possible states and 2) choosing a 
partition of n 'atoms' into n/m 'molecules' out of n! possibilities of such partitions. The 1RSB ansatz yields, 



PH| ~£ exp 



SP 




(B17) 



where X)sp stands for summation over all possible I RSB solutions explained above. Here the summand is common 
for all IRSB solutions so that X]sp J us ^ yi e ld a multiplicative factor, 

^ (M-^)!(m!)-/m' [ 8j 

which becomes I in n — > limit. The IRSB free-energy is related to the RS free-energy simply as -Flrsb (T, h) — 
Fns(T/m,H). Extremization with respect to the parameter m, 

Q= ^SB (Big) 

dm 



is formally identical to the condition S^s(T/m,H) = as first noted by Monasson j53|. Then one finds, 

T 



(B20) 



T c (h) 

At T < T c (h), the thermodynamic free-energy is fixed to 

F(T,h)/N = -2cT c (h). (B2I) 

This agrees with Eq. p39]) . 



APPENDIX C: LOW TEMPERATURE EXPANSIONS OF THE MOMENTS OF THE 

SUSCEPTIBILITIES 

In this appendix we report some details of the computations by the low temperature expansion of the sample- 
averages of some moments of the thermal cumulants. 



1. Accuracy of A/-level models 



Here we proove that a M-th level model, which only takes into account the lowest M levels, give correct results of 
the moments up to order 0(T/T c ) M_1 . 
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We first note that Eq. (|45|) can be formally expanded as, 



M-l 



(=1 0<ni<ri2...<n/ 



k=l 



(CI) 



The coefScients C l pi)J)2! are to be obtained after averaging over the Y variables, which can be done interdependcntly 
of the X variables since they are independent from each other. We remind the readers that we are considering the 
transverse Y variables. 
From the latter we find, 



(X k ) n Pk (X k )dX k = 
o nT c [h) 



i + k - T 



n T c (h) 



(C2) 



which yields, 



T 



1 1 u 

, TT- 

T c (h)J l = ln fc 



k T 
n k T c (h) 



(C3) 



Using Eq. (|C3[) in Eq. (|C1[) we notice that M + 1-level model would give the same results as the M-level model except 
that it will have additional terms of order 0(T/T c (h)) M (and higher order terms). This in turn certifies that finite 
M-level model should give correct results up to 0(T/T c (/i)) M ~ 1 . 

Thus to collect 0(T/T c (h)) terms a 2-level model is sufficient. A 3-level model gives only 0(T/T c (h)) 2 correction 
terms which take care of rare samples in which three levels happen to become degenerate as shown in Fig. [5] 

Let us note that somewhat similar reasoning has been used to justify the phenomenological Imry-Ma type scaling 
arguments for glassy systems by Fisher and Huse [HI, [3| which assume some kinds of schematic low temperature 
expansions. The class of mean-field models we consider here enable explicit low temperature expansions. 

The low temperature expansion can be implemented also to compute the so called participation ratios, 



M-l 
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1=0 



Wf 



M-l 
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n 



k=l 



x k 



(C4) 



Evidently it can be formally expanded in the same way as Eq. (|C1|) . The participation ratios have been computed 
without the replica method using the exponential distribution of random free-energies Eq. flMJ) reproducing the replica 
results 46] in the M — > oo limit. Our result implies finite M-model gives correct result up to 0((T/T c (/i)) M_1 ). 



2. Linear susceptibility 



Following the prescription Eq. (|45[) the sample-average of 1st moment of the 2nd thermal cumulant |[k2(F)]| 
is computed within the 2-level model as the following. 
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Here we used Eq. (|44j) and Eq. (j28[) to evaluate the sample averages. Then repeating the computation in 3-level model 
we obtain, 



\MY)}\ 



3— level 



Q r\ r\ 

Y ^7^r + Y ^7^r + Y ^7^r ) ^Z(O ,O 1 ,O 2 ,X 1 ,X 2 ] 
oO a oOi 0O2 



0=1. 



(Vna cS 
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(ViVA eff ) 2 \ 2 In 2 
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T c (h) 
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T c {h) \T c {h) 



(C6) 



Note that in the 2nd equation we have slipt the integral into two parts, one of which corresponds to that of the 2-level 
model. 

By similar procedure the sample-average of 2nd moment of the 2nd thermal cumulant [ftfC^)] i s computed 

within the 3-levcl model as the following. Following the prescription Eq. (j4"5)) the sample-average of 2nd moment of 

the 2nd thermal cumulant [k 2 ^)] 3 1CVCl i s computed within the 3-level model as the following. 



3— level 
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hxZ(O 01 , On, 2uXl) X 2 ) lnZ(0 Q 2,0 12 , 2 2,X 1 ,X 2 )\ 0=1 



12(7VA 2 ) 2 / d Xm ( Xl ) 



X( 



(1 + Xl ) 



12(JVA 2 ) 2 f d XlPl ( Xl ) f d X 2 P 2( X 2) 

Jo Jo 



X 2 (l + X 2 + X 2 + XlX2 + X X X\ + XjX£ 
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In the last equation we have again slip the integral into two parts. The 1st integral corresponds to that of 2-level 
model which is evaluated as 



X 2 1 T 

o dXm{Xl) jrrX^ = UTjh)~' V24 6 



1 '^(JLYz+o' T 



T c (h)J \T c (h), 

while the 2nd integral corresponds to the contribution due to the 3rd level which is evaluated as, 
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Combining the above results we finally obtain Eq. (I47p . 



(C8) 
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3. Non-linear susceptibility 



Using Eq. (|45p the sample- average of 2nd moment of the 3rd thermal cumulant [/^(K)] cv ° is computed within 
the 3-level model as the following. 
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In Z(O 0X ,O xx ,O 2X ,X x ,X 2 ) In Z(O 02 , 12 , 22 ,X x ,X 2 )\ 0=1 

= (iV(A cff ) 2 ) 3 f dX lPl (X 1 ) [ dX 2P2 {X 2 )F{X u X 2 ). 
Jo Jo 



(C9) 



where 



F(X 1 ,X 2 ) = 12X1 [ 10 + 48X 2 X 2 - 7X\X 2 - 7X X X 2 



-7X\X\ + lOXfxf + lOXf - 20X X X% + \0X\x\ - 2§X{X\ + ioxfx$ - 7X X X\ 

-ix\x\ + ix\x\ - 2ox 1 + 7x 2 - ixlxl + ix\x 2 + loxf] (1 + x x + x x x 2 y & 

Again the integral can be split into two parts. 
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The 1st integral on the r.h.s corresponds to that of 2-level model which is evaluated as 
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while the 2nd integral on the r.h.s corresponds to the contribution due to the 3rd level which is evaluated as, 



jf dX 2 p 2 (X 2 ) j F(X X , X 2 ) - 120 + ^7" 1 } 
Combining the above results we finally obtain Eq. (|48[) . 
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4. Other moments 



Here we present results of some other moments needed in the present paper using the 3-level model. The 2nd 
moment of the 1st thermal cumulant is evaluated as, 
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We also need |[k3(F)ky]| which is evaluated as, 
\[k 3 (Y)k 1 Y}\ = 
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APPENDIX D: DISTRIBUTION OF MESOSCOPIC RESPONSE AT T = 



In this appendix we compute the distribution function Eq. (|51[) of the response ip = Y{h + Sh) — Y(h) at zero 
temperature. For our convenience let us introduce some short hand notations, 



DY,...= 



dY, 



■. exp 



2NA 2 



J DF(j >m ) ... = j dAF t 

,m J * * • • 



(Dl) 



whe re p^ m )(Ai 7 j, m ) is the distribution of the free-energy difference A_Fi !m between Z-th. and m-th states under h (See 
sec. IIIIBip . 

For the two-level model it is easy to find, 
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using Eq. (jDip .Eq. [)28p and Eq. (|26p. We again remind the readers that we are actually studying the fluctuations of 
the transverse variable Y. Here the 1st and 2nd terms on the r.h.s correspond to Poty) and Pity) respectively. 

Now we extend the analysis including the 3rd state. Among the diagrams shown in Fig. \7\ the cases that the state 
I becomes the ground state appear in 3), 4) and 6-b). Then we can write it as, 
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DY 2 / DAF 21 

Yi Jh(Y 2 -Y 1 ) 

Here the 1st term in [. . .] is the contribution from the case 3) and 4). The 2nd term [. . .] is due to the case 6-b). Using 
Eq. (J2HD and Eq. we obtain, 
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in the last equation we introduced new variables Y± = Y\ ± Yq and explicitly integrated over Y"_ . The distribution of 
the scaled variable ip given in Eq. (|54|) is obtained as, 
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where h s is given by Eq. (|57|) . 

Next we examine the cases that the state 2 becomes the ground state which can be found 5), 6-a) and 6-b) in the 
diagrams in Fig. [7] which yield, 
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The 1st term on the r.h.s. of the above equation is due to the case 5) while the 2nd term is due to the case 6-a) and 
6-b). The last two integrals in the 2nd term ensure that both two level crossings (1, 2) and (0, 2) have took place in 
6-a) and 6-b). (The order is reversed in the two cases.) 

Using now Eq. (j28|) and Eq. (j26|) for the (0,2) level crossing, which is "repulsive", we obtain, 
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In the 1st term on the r.h.s of Eq. (|D8[) we used Y± = Y 2 ± Yq and explicitly integrated over Y_. 
From the above result the distribution of the scaled variable tp given in Eq. (|54|) is obtained as, 
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APPENDIX E: COMPUTATIONS OF SAMPLE-TO-SAMPLE FLUCTUATIONS OF THE THERMAL 

CUMULANTS BY A REPLICA APPROACH 

Here we report some details of the computations of the moments of thermal cumulants Kk(Y) using the prescription 
Eq. (|57|) . which reads as, 
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In Eq. (|E1[) the sum y ^ stands for summation over all possible partitions of n t ot replicas into Utot /fn clusters of 
size m. 

In the 2nd equation (. . .) gp is the average over the all possible 1 step RSB solutions obtained by permutations of 
replicas , i.e., 

(•..>8p = ^F— (E3) 



^ SP 
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The computations of the moments based on the formula Eq. (|E1[) can be done diagrammatically. For instance let 
us consider the case of [k 2 (X)] , i.e fc = 2 and p = 2. In this case we have 4 derivatives in Eq. (|E1[) among which 2 of 
them are associated with the group-1 of replicas and the other 2 are associated with the group-2 of replicas. 

1. First we represent them by 'isolated indexes' as in the left hand side of Fig. [13J T' means that it stands for a 
derivative associated with the group-1 of replicas and '2' means that it is associated with the group-2 of replicas. 

2. All terms generated by the differentiations d/d8h at Sh — in Eq. (|Eip can be enumerated by making pairs of 
indexes as in the right hand side of Fig. [T5] As the result we find 

[400] = (^(A cff ) 2 ) 2 • lim J-(( All A 22 ) SP + 2 (Aj 2 ) sp ). 

J ni,n 2 — 1-0 n\Tl 2 
2 



Here A\\A 22 is due to the graph a) and 2A{ 2 is due to the two graphs of type b) 




FIG. 13: A diagrammatic representation of terms which survive after Sh — » among all terms generated by the differentiations 
d/dhs in Eq. (|ETj) . 

3. Now we have to evaluate (AuA 22 ) SP and (Af 2 ) gp . Let us take the case of (^4iiA 2 2) SP which is represented by 
a) in Fig. [H 

Using Eq. (|89]l . (Anvl22)gp can be written explicitly as, 

(l,n x ) (l,ni) (2,n 2 ) (2,n a ) 

(AiiA 22 ) SP = £ £ £ £ <^ci^H,i 5 > S p- 

a=(l,l) /3=(1,1)7=(2,1)«=(2,1) 

Here replicas a and (3 belong to the group-1 while 7 and 5 belong to the group-2. 

To proceed further, we classify the terms in the multiple free-sums over replica indexes into some subsets as 
represented by the diagrams in Fig. Q3] Different diagrams represent different ways to contract the indexes. 
From now on indexes represent replicas which do not overlap with each other. Each bond represent a Kronecker- 
delta. A diagram consists of one or several sets of 'connected bonds'. A sum over replicas is associated with 
each index, under the constraint that replicas associated with different indexes do not overlap with each other. 
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Thus the diagrams are identified as follows 

a )" 2 E (**7.<*)sp 

a )-3 -> E (^°.v)sp 

a,/3;7 

a)-4 - X)' (<W^) SP (E4) 

Here a and /3 belong to group- 1 while 7 and <5 belong to group-2. We use the symbol to mean that the 
running indexes do not overlap with each other; 

E ••• = 2 E E -2E E 

a,/3;7,5 a—1 (3—a+l 7=1 5=7+1 

a)-l a)-2 a)-3 a )_4 

O O 1 — 1 1 — 1 

1 1 ^ 20 2 —2 20 2 —2 

2 — 2 a=p a = p p oc^(3 



FIG. 14: Classification of the terms in {A11A22) SP represented by the diagram on the left hand side. Indexes on the diagrams 
a)-l to a)-4 represent non- identical replicas and their numbers represent the groups to which they belongs to. 

4. Now we are left to evaluate expectation values (. . .) gp (See Eq. (|E3[) ) of the diagrams. An 1RSB solution is 
represented by a configuration of clusters (See Fig. ITTj) . 

Note for instance that Si a> i is in a solution where a and /? belong to different clusters. Thus we just need to 
count numbers of 1RSB solutions in which all replicas belonging to a set of 'connected bonds' are contained in 
a common cluster. 

For example let us consider the case of a)-4; 

E (^w/3<^M«)sp 

There are two possible configurations of clusters which make non-zero contributions, say a)-4-l and a)-4-2 as 
shown in Fig. [T5l 

The case of a)-4-l is evaluated as follows, 

n to t m(m-l) (m — 2)(m-3) 

ni(m - 1) x n 2 (n 2 — 1) x — x 



m n tot (n tot - I) (n tot - 2)(n tot - 3) 
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FIG. 15: A schematic representation of some 1RSB solutions. Closed circles represent clusters of the 1RSB solutions, m 
replicas belong to group 1 (blue) and 112 replicas belong to group 2 (red) . The replicas of the two groups n to t = ni + ri2 are 
mixed together and divided into clusters of size m. Here two kinds of solutions which make non-zero contributions for the 
diagram a)-4 are shown: the two sets of 'connected bonds' 1 — 1' and '2 — 2'are contained in a single cluster a)-4-l or in different 
clusters a)-4-2. 



The first two factors ni(rc.i — 1) and n 2 (n 2 — 1) represent number of ways to choose the 4 different replicas 
associated with the 4 running indexes in a)-4: 2 replicas are chosen out of n\ replicas in group-1 and 2 replicas 
are chosen out of n 2 replicas in group- 2. The last two factors 

n to t m(m — 1) (to — 2)(m — 3) 



m n tot (n tot - I) (n tot - 2) (n tot - 3) 
are the probability to have a solution like a)-4-l in Fig. 1151 given n to t replicas. 

The probability is obtained by counting the number of such solutions and dividing the result by the total number 
of solutions n to t!- In the case a)-4-l all 4 replicas associated with the 'connected bonds' are put in a single cluster. 
Thus first we note that there are n to t/?7i possible ways to choose the cluster among n tot /m clusters. Then we 
note that there are m(m — l)(m— 2) (to — 3) different ways to choose 4 distinct replicas for the running 4 indexes 
out of m replicas in the cluster. Last we note that there are (ntot — 4)! ways to choose the rest of replicas. Thus 
the number of solutions we wanted is ntot/ni x m(m — l)(m — 2) (to — 3) x (n to t — 4)!. Then dividing the latter 
by the total number of solutions ntot! we obtain the factor displayed above. 

The case of a)-4-2 is evaluated in the same way as follows, 

, lX , ^ "-tot to(to-I) /n to t A m(m-l) 

ni m - 1) x n 2 n 2 - 1) x x ( 1 — — . 

m ntot(n t ot-l) v m / (n to t - 2)(n to t - 3) 

Here the factor n to t/?n — 1 is the number of ways to choose a '2nd cluster'. 
Summing up the results of a)-4-l and a)-4-2 explained above, we obtain 



iim — - — y] (^o.is^.'^sp 



a,/3;7,<5 



I \n tot m(m-l) (m-2)(m-3) 

hm ni(ni - l)n 2 (n 2 - 1) 



ni,n 2 ^onin 2 ' \m n tot {n tot - 1) (n to t - 2)(n to t - 3) 

n to t m(m - 1) / n tot _ \ to(to - 1) 



m n to t (n to t - 1) V m / (n to t - 2)(n tot - 3) 
(1-to)(2-to)(3-to) to(I-to) 2 
3! + 3! 
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a. Linear susceptibility 

The linear susceptibility is related to the 2nd thermal cumulant as xi — P K 2(Y). In section IV Bl we present the 
computation of the sample-average of its 1st moment |[k 2 (Y)]|. 

In the following we describe computation of the 2nd moment ■ in the previous subsection sec. IV Al we have 

already found that 

[4(Y)} = N(A cS ) 2 ■ lim -L-UAuAv)^ + 2 (A 2 12 ) sp ). (E5) 

This is obtained by analysing possible pairings of the 4 'running indexes' as in Fig. [13] Next (AuA22) SP and (A^/ap 
must be evaluated. 

In the previous section we have evaluated (AiiA22)sp to a certain extent. First we noted that it can be considered 
as sum over contributions from diagrams a)-l to a)-4 shown in Fig. 1141 An important point there is that the multiple 
'running indexes' do not overlap with each other. We have evaluated the contribution from diagram a)-4. 

In similar ways we obtain contributions from other diagrams a)-l to a)-3. From diagram a)-l we simply find 



lim J—y'i = 1 . 

a;7 



From diagram a)-2 we find, 



SP 



1 , lN n to t m(m-l) 
lim — ri2\ni — 1J- 



n 2 ->o n 2 m ntot(ntot — 1) 

= — (1 — m). 

From diagram a)-3 we obtain the same result. Summing up these results we obtain, 



1 . , „. . f (1 — m)(2 — m)(3 — m) mfl — m) 

lim ^11^22 S p = 1 - 2 1 - m + ^ A „, A - + V „, 7 

ni,n 2 ->0 mn2 [ 3! 3! 

The evaluation of (Af 1 ) sp which reads as 

(i,m) (2,m) (l,n 2 ) (2,n 2 ) 

< j4 ?2>sp= E E E E (<w^) SP - 

Q ! =(l,l)/3=(2,l)7=(l ) l)5=(2,l) 

can be done in the same way. Diagrams corresponding to those in Fig. [14] are the diagrams b)-l to b)-4 shown in 




FIG. 16: Diagrams contributing to {^i 2 ) gp . Indexes on the diagrams represent non-identical replicas and their numbers 
represent the groups to which they belongs to. 
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Fig. [T6j The diagrams are evaluated as the following, 

1 x - 

b)-l — > lim > (S a ~ Lp = 1 



a;7 



1 v - 

b)-2 -> lim > (5 Q , 7 ^, 7 ) SP 

a,p;7 
1 W 

b)-3 -> lim > ((Ja^Ja^)^ = 

rai,n 2 ^0 n\n 2 

a;7,o 
1 x - 

b)-4 — > lim ) ((5q, 7 5/3,5) sp 



(1 -m)(2- m) 



(1 - m)(2 - m) 
2 

(1 — to)(2 — to)(3 — m) m(l — to) 2 



3! 3! 

a,/3;7,o 

Note that b)-4 is equivalent to a)-4 so that one must consider two kinds of solutions with different patterns of clustering 
as those shown in Fig. 1151 Summing up the above results we obtain 



1 , a > (1-to)(2-to) f (1-to)(2-to)(3-to) to(1 - to) 2 | 

m,n 2 ^o nm 2 ^ 12 ^ SP ' "' " 2 \ 3! 3! J 

^m(l-m). (E7) 



Using Eq. (JE6J) and Eq. (jE2J) in Eq. ([E5J) we finally obtain Eq. (|94j). 

[« 2 (y)] = (7V(A cff ) 2 ) 2 TO. (E8) 

b. Non-linear susceptibility 

The non- linear susceptibility is related to the 2nd thermal cumulant as \2 = (P 2 /^-) K 3(Y). Due to a simple 
symmetry reason sample-average of the 1st moment |[k3(^)]| is zero. We examine sample-average of the 2nd moment 
[k§(Y~)] below. Following the steps 1,2 in sec. IV Al we obtain, 

[4(Y)} = (iV(A cff ) 2 ) 3 lim -i-(9 (A U A 12 A 22 ) SP + (A? 2 > sp ). (E9) 

First we evaluate, 

lim — !— (A 11 A22A 12 } S p 

m,n 2 — >0 nitl 2 



(l,ni) (l,ni) (l,ni) (2,n 2 ) (2,n 2 ) (2,n 2 ) 



= ni |i- ^ E E E E E E (^v^O*.- (eio) 

ai=(l,l) 03=(1,1) as=(l,l) /9i=(2,l) &=(2,1) /3 3 =(2,1) 

Following the step 3 in sec. IV Al the sum with 6 running indexes can be divided into contributions from the diagrams 
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a) -l a)-2 a)-3 a)-4 a)-5 a)-6 
^ 1 9 A „ } 1 / 2 1 — 1 1 1 — 1 

I /\ 2 I I 4 /\ I 4| | 

2Q 2 O 2 1 2Q 2 1 1 2 2 2 — 2 2 2 — 2 

b) -l b)-2 b)-3 b)-4 b)-5 b)-6 b)-7 

1 1 1 11 1 1 2 1 2 1 1 1 

HI 6 || 3 || I 2 /|\ 6 I I 6 I I Ml 

2 2 22 222 2 — 1 2 — 1 1 222 

FIG. 17: Diagrams contributing to [/^(Y)]. The upper 6 diagrams contribute to (Ai2A22^4i2) SP and the lower 7 diagrams 
contribute to ^j4f 2 ) gp - The numbers of the left hand side of the diagrams represent numbers of the graphs of the same geometry. 

a)-l to a)-6 shown in Fig. [T7J Then by the step 4 they are evaluated as the following, 

1 ^-V 

a)-l — > lim } (S a2 fl 2 )p P = lim mn2(l — m) = 

rai,na— >0 n\Tl2 — ' ' ni,7ia— »0 

ai ,a2;/3i,/32 

a)-2 -> lim — !— V" (^ai,a 2 5 a , «, ) QP = lim O(m) = 

"1 >c«2;/3i 

a)-3 -> lim — !— ((Wa^c )qt> = lim O(rti) = 

ai ,a2,Q3;/3i ,/3 2 
1 \ , 

a)-4 -> lim > (^a^asA^.P^SP 

ni.na^O nm 2 ^„ . 

m(l — to) 2 (2 — to) (1 — to)(2 — m)(3 — to)(4 — to) 



-2! 



4! 4! 

(1 — m)(2 — m)(3 — to) 

>pVsp — 



1 \ , 

a)"5 -> lim \ (Sai.oyAa./Jifyi,/^ /M' 

m,ri2->o nin2 ^-^ 0! 

"1 ,C2\Pl ,P2 
1 \ V 

a)-6 -> lim > {^^fiiA^s,^) 



., , op 

"1,12— >o niri2 z — ' 

ai ,a2,a3;pi,P2,P3 

_ , 2 f 2!to 2 (1 - to) 3 q to(1-to) 2 (2-to)(3-to) 
~ [ ' } { 5! +3 5! 

(1 — m)(2 — to)(3 — to)(4 — to)(5 — to) 
+ 5! 



(Ell) 



Next we evaluate, 



lim — !— (A? 2 )„ p 



(l,ni) (l,m) (l,rn) (2,na) (2,n 2 ) (2,n 2 ) 

ni ^ — E E E E E E <<W^aW SP - 



ai=(l,l) aa=(l,l) a 3 =(l,l) /3i = (2,l) fts=(V) fti = (2,l) 
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l) 2) 
11 2 1 

3 I I 6 \/ 

2 1 1 



FIG. 18: Diagrams contributing to [«3(Y)/«i(Y)]|. The numbers of the left hand side of the diagrams represent numbers of the 
graphs of the same geometry. 

The sum can be divided into contributions from the diagrams b)-l to b)-7 shown in Fig. I17[ which are evaluated as, 

1 v-^' 

b)-l —> lim } (Sa^p^e-p = 1 - m 

m,n 2 -»0 nin 2 ^ wi'br 

1 x V 

b)-2 lim > {5 aiia2 5 aiA ), 



' Q i;/3i 

(1 - m)(2 - to) 



/sp 2! 

ai,a 2 ;Pi 

1 w v to(I-to) 2 (l-m)(2-m)(3-m) 

b)-3 — > lim > fl ai ,tt 2 i)ft, 



,^2/SP : j| 1 •>! 

'ai,a2;/3i,/32 



1 \ - 

b )"4 I™ n V (^ai./Si'W.ft^.ftJsP 



2! 



(I — to) (2 — m)(3 — m) 



ni,n 2 ^o ni n 2 i—' 5 ^ 3! 

ai;/3l,P 2 .P3 



1 w . (l-TO)(2-m)(3-m) 

b "5 -> lim > (<Jct 1 ,/3 1 0a 2 ,/3i"a: 2 ,/3 2 )gp = rj" 

ni,n 2 ^0 ni7l2 * — ' o! 
ai,a 2 ;/3i,/3 2 

1 

b)-6 -> lim > (SauPtSa^pJaa 



/ -i3,/3 2 /SP 
ni,n 2 ^0 mri2 * — ' „ 

Qi,Q 2 ,a 3 ;/3i,/3 2 



= -2! 



m(l - to) 2 (2 -to) (1 - m)(2 - m)(3 - m)(4 - to) 
4! + 4! 



1 \ — V 

b)-7 -> lim > (^Q 1 ,/3 1 (5 Q2 ,/3 2 (5a3,/33)sp 

Qi,a 2 ,a 3 ;/3i,/3 2 ,/33 

to 2 (1 — to) 3 to(1 — to) 2 (2 — to)(3 — to) 

5! +3 5! 

(1 — to)(2 — to)(3 — to)(4 — to)(5 — to) 



(E13) 



5! 

Summing up the above results we finally obtain Eq. (I95p . 

[4(Y)} = {N(A cS ) 2 ) 3 2m(l - to). (E14) 



c. Other moments 



Here we present results of some other moments needed in the present paper. 
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The 2nd moment of the 1st thermal cumulant is evaluated as, 

1 d d 



[k\{Y)\ = (ViVA cff ) 2 lim 



nin 2 dxi dx 2 



exp 



'i^ . v 

2 / J x r J± rs x s I 

\ r,s=l / , 



SP 



x=0 



(VNA cff ) 2 {A 12 ) sp = (ViVA cff ) 2 / £ s iati0 
(\/7VA cff ) 2 (l-m). 



SP 



We also need |[k 3 (F)ky] which is evaluated as, 



\[k 3 (Y)k 1 (Y)]= (VTVAeff) 4 lirn lim 



1 d 3 d 



n 1 —>0n 2 — »0 7liri2 9xf dx 2 



exp x r A rs 2: s ^ 



SP 



x=0 



(VNA cS ) 4 lim lim — !— 3(4 u 4i2> SP 



NA 



=ff) 4 Hm n — — ( 3 E (^/s^SP + 6 E (Si, 
\ a,/3,7;(5 a,/3;<5 



(V7VA eff ) 4 m(l-TO). 



(E15) 



(E16) 



The 1st and 2nd terms in the brace (. . .) in the 2nd equation from below correspond to the two diagrams presented 
in Fig. [TBI which are evaluated as the follwoing. Diagrams corresponding to 1) in Fig. [18] yields, 



um — — E (Si a ,igSi^,is)^T> 



^ (1 — m)(2 — to)(3 — to) ^ ^m(l ~ m) 2 



3! 



3! 



(E17) 



The lst/2nd term on r.h.s is due to the cases that '1-1' and '1-2' belong to the same/different clusters. On the other- 
hand diagrams corresponding to 2) in Fig. [TBI yields. 



lim n ~~ E ( S ic,i Si i d )„ 



a,f};S 



(1 - m)(2 - to) 
2! ' 



(E18) 



APPENDIX F: ANALYSIS OF THE CUSP BY A REPLICA APPROACH 

The solution can be obtained by closely following the approach of (321 which we outline below. First let us slightly 
modify how to take the summation over the solutions X)sp- ^ n our original representation Eq. (199p there are n/2 
replicas belonging to group T' and the other n/2 replicas belonging to group '2'. Then 1 step RSB solution is given 
by mixing up all replicas and then deviding them into clusters of size to. We note that it is equivalent to say that 
there are n/m clusters of size to and 1 step RSB solution is specified by deciding which group ('1' or '2') each replica 
belongs to. Using this mapping we can rewrite the summation over the solutions in Eq. ([99]) as, 

/ -. 2 x , x , (l,n/2) (2,n/2) \ 

exp E E 

SP \ r,»=l a=(l,l)/3=(2,l) / 

= E' ex p (iE J °> 

Here I a \, is a standard Parisi's matrix for 1 step RSB which is block-diagonal: block size is to and the elements are 
/ = 1 in the block-diagonal part and 1 = for the rest (See Fig. [T2"|) . We also introduced 'Ising variables' a a = ±1 
for a = l..n. The summation ^ CT means to a trace over the Ising variables under the constraint that J2l=i °a- = 



~l-a a Shi , l + cr a 5hi 



1 — (T{, Sh 2 1 + Oh Sh 2 
2 hT H 2 /i7 



(Fl) 
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To simplify notations we introduce hi — 6h±/h s and hi = 6hi/h s . Using a Hubbard-Stratonovich transformation 



eTS.,»'.i _ 7 jt= e -2n e T, a " w ith A > 0, we obtain, 



,6 

n/m 



1-ffaT , 1 + <?a 7 
« "1 "I ^ "2 



1 - cr 6 - 1 + er b - 
— ^ — "i H ^ — "2 



e n 



(h 1 +h 2 ) A 



exp 



B(-n/2 7 -n/2) 



dy 



DC 



00 dA' 



/27T 



4to 



e 2 cosh(y + VAA') 



n/m 



with 



.4 



(hi - h 2 ) 
Am 2 



(F2) 



(F3) 



Here C = 1, 2, . . . , n/m are the blocks of the block-diagonal matirx J a f, and J2 a <=c denotes a summation over replicas 
beloging to a block C. To obtain the last equation we used the constraint Yl2=i ° a ~ and the identity (32j, 



2 n+l 



dy cosh(y + h a ) 



B(-n/2,-n/2) 

Chaging variabiles with /i = sgn(ft,i — /i2)A' and /i = e~ 2y we can rewrite the integrals as, 



(F4) 



/do r /*c 

dy y 



dX 1 



e — cosh(y + v AX') 



n/m 



(h 1 -h 2 ) 2 1 



9n+l / // 



d M, -»/2 



71^ 



2m -f ^ e 2m 



n/m 



Summing up the above results and using lim„_,o nB(n/2, n/2) = 4 we obtain, 
(Y(h + 6h 1 )Y(h + Sh 2 )) 



lim 

r-o (s/NA eS {h Q )) 2 

= — lim lim 



o-o«a(^)a(^) 



e 4 " 



5n + 5i2 



with 



and 



/2 _ii 



gi2 = e 4 

7T 



o A 4 



e x 2 ( x 2 - L) 



dft. f (h-hj) 2 (h-h 2 ) 2 

e 2™ +fie 2™ 



e-^M (x- f )+e^M (-x- 



dx 

' { e -^ Mo{x _R ) + e ^ Mo {- x -&)}' 



m_ 

2^F 

JL 

2^ 



0(\l\ 2 ) 



0(\l\ 2 ) 



with 



and 



M k (x) 



dz 



I = 



'2tx 



Shi — Shi 



h — 2— 

z K e 2 



(F5) 



(F6) 



(F7) 



(F8) 



(F9) 



In the above equations we changed the integration variable using /i = e~ x ~^ . For the details of the evaluations of the 
to — > limit of the integrals see 32]. In order to obtain the last equation of Eq. (|102p . we expanded the integrals by 
|/| and repeated some partial integrations and some Gaussian integrals. 
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APPENDIX G: FLUCTUATIONS OF CLUSTERS IN ONE-STEP RSB SOLUTIONS 



Let us recalled that a given 1RSB solution is described as a configuration of n replicas grouped into n/m clusters of 
a unique size m. (See Fig. 1111 ) Being motivated by a work by Campellone et al [59|, we now consider a class of more 
generic solutions where the sizes of clusters can be inhomogeneous. As noted in sec [V] this is necessary to evaluate 
the parameter A e g in the generating functional Eq. (|85p properly. 

The need to take into account the fluctuation of m has been pointed out by several authros. Especially it has 
been pointed out [58| that if one computes the heat capacity from the thermal fluctuations of energy E via FDT: 

(l/N)/3 2 (-E 2 ) — (E) 2 neglecting fluctuations from the usual 1RSB saddle points, one does not recover the correct 

thermodynamic heat-capacity that one obtains by taking two time derivatives of the thermodynamic free-energy by 
temperature T. It has been suggested (57l. l58l. fsoj] that one then must consider fluctuations from the saddle point, in 
particular, the size of clusters m explicitly. 

Fluctuations of the size of clusters, seem rather different in nature from the usual small fluctuations [5|| of the 
amplitude of each element of the Parisi matrix. In particular in the case of REM the overlap between the states 
can be either or 1 by the construction of the model so that fluctuation of the size of clusters amount to very large 
fluctuations of the amplitudes of the elements of the Parisi matrix . 

For simplicity we consider below an effective REM with the simple generalized complexity given by Eq. (|17p . 



1. Fluctuations of clusters 



In order to obtain some insights let us consider first disorder-average of the replicated partition function given by 
Eq. (|B14)> . 



[Z n j= £ exp 

l\ ,12,..., 'i n — 1 



cN(/3T c (h)) 2 ]T 

a, 0=1 



(Gl) 



A given configuration of n replicas of the REM can be viewed as a collection clusters. A cluster is a set of replicas 
sitting on the same microscopic state among M = e cN possible states. We label them as Ci, .. . ,Ci where I is the total 
number of clusters. We denote the size of 7th cluster , namely the number of replicas belonging to Cj, as m/. 

Now using an identity 



Si ^0 = J2 m2 i- 



a, 13=1 



1=1 



we can rewrite the replicated partition function as 



i j { mi } ii/=i 



--/VG({mj},A,Z) 



miW 



(G2) 



with 



G{{mi}, A, I) = i 1 + {{3T c (h)) 2 mj + Am/} - cXn 



(G3) 



i=i 



here we imposed the constraint 



mj = n 

1=1 

by introducing a Lagrange multiplier A. The effective action G can be cast into the following form, 

I 



(G4) 



G{{mxW) =l + m{h)f n 



I 4(/3T c (/ l )) ; 



-(A - A*(/)) 2 + (l3T c (h)) 2 Y^{mi ~ m*(X) f 



i=i 



(G5) 



4G 



with 



Thus wc find 



TO* (A) 



A 



2(PT c (h)Y 



\[Z n ]\ = J2 e cN ^ l +T^(h)f] j cNdXe ~M^k? 



(A-A-(i)) 2 



1 f 



,cN(f3T c (h)) 2 (m I -m"'(X) 2 



(G6) 



(G7) 



Here the order of the summations and integrals is crucial. In order to enforce the constraint Eq. (|G4[) . G must be 
maximized with respect to A. On the other hand, G is minimized with respect to {mi} at to/ = to* (A) and I — I* 
given by 



7* 

I = n 



If we disregard fluctuations completely we recover Eq. ((78 



T 



T c (h)- 



rrn ~TO*(A*(r)) 



T 



T c (h) 



(G8) 



(G9) 



which is the well known result. Note that usual extremization of the uniform cluster size to (See Eq. (|B19[) is equivalent 
here to extremization of the number of clusters I. 

In the following we denote fluctuation of the size of cluster Cj as 

5mi = to/ -m*(A). (G10) 

From Eq. (|G7j) we find that measure for small fluctuations of the sizes of individual clusters Smj is given by, 



! J / dnije 
1=1 J 



cNipT^YSm] 



(Gil) 



The saddle point <5to/ = is the minimum which is a strange feature in the n — » limit [2a . |44j . 

2. Generating functional for correlation functions of energy 

Based on the above observations, let us now construct a generating functional for the correlation functions of energy 
E. Let us consider p real replicas r = 1, . . . ,p, which are replicated further into n r replicas, at inverse temperatures 
[3 + 5[3 r - Here 8(3 r is considered as small 'probing fields'. The disorder-averaged partition function of the whole system 
is given by, 



M=e c 



M I V (»W) 
i=l \r=\ a=(r,l) 



(G12) 



In a given configuration of the system, ntot = n\ + . . . n p replicas are divided into I clusters of sizes mi (I = 1, . . .,/). 
Then we find the exponent in the r.h.s. of the last equation can be expanded as, 



M I P r,n r \ I 

cN J2 X> + <WT c (/i) J2 kiA =cN{PT c (h)) 2 Y™ 2 i 

i=l y r =l a=(r,l) / i"=l 
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(G13) 



Here /(a) used in the 2nd term on the r.h.s. denotes the label of the cluster to which the replica a belong to. 
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Apparently the 3rd term on the r.h.s. of the above equation generates a 2nd order term 0((5(3) 2 ) in the effective 
action of the generating functional quite similar to the one in Eq. (|85[) . It can yield a spurious finite heat capacity and 
a spurious temperature-chaos below T c (h). However we know for sure that O(N) heat capacity is (See Eq. (|B12j) ) 
and temperature-chaos is absent in REM since temperature-changes cannot induce any level crossings of free-energies 
in the origianl version of the REM (See [27j for a related discussion). Thus in the present REM the 0((5(3) 2 ) term 
must be cancelled. 

Now we consider effects of fluctuations of the size of clusters. Note that the 2nd term on the r.h.s. of Eq. (|G13|) 
can be decomposed as, 

p (r,n r ) p I 

2cN(f3T c (h)) 5[3 r T c (h) £ m I[a) = 2cN((3T c (h)) £ 6f3 r T c (h)n r m* (A) + 2cN(f3T c (h)) ^ <5m 7 £ Sf3 a T c (h). 

r=l a=(r,l) r=l 1=1 aed 

(G14) 

where 6(3 a is the probing field applied to replica a. Here we find the probing field 6j3 r in a cluster Cj is linearly 
coupled to fluctuation of to/. 

Exponentiating the 2nd term in the r.h.s. of Eq. (|G14[) and applying the measure for the fluctuation of Smj given 
in Eq. (jGllj) we obtain, 
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(G15) 



in the last equations we changed the integration variable to Sra'j = dm j + X)aeC/ ^ ne ^ as ^ resu lt implies we have 
another 2nd order term in the action 

p {r,n r ) (s,n s ) 

~ cN E ( s PrT c (h))(5f3 s T c (h)) E 

r,s=l a=(r.l) /3=(s,l) 

which exactly cancels the other 2nd order term in the action, i.e. 3rd term on the r.h.s. of Eq. (|G13|) . In another 
word, the effective variable Eq. (|2"D)) of the energies is 



A off - 0. 

As the result we obtain the generating function for the fluctuations of energies as, 
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(G17) 



where the sum y ^ stands for summation over all saddle points where n to t replicas are grouped into n to t /m clusters 

of size rn. Here m is the saddle point value given in Eq. ([75)1 (See also Eq. (|G9[0 . The 0(6(3) term in the 2nd exponent 
is due to the 1st term in the r.h.s. of Eq. (|G14[) . 

It can be seen easily that the 0(6/3) term in the action generates the correct average energy 



E/N=^ = -2cT c (h) 



(G18) 



in agreement with the one obtained from the thermodynamic free-energy (See Eq. (|B9|) V The absence of the 2nd order 
term 0(5(3) 2 in the action means that heat capacity is indeed zero at 0(N) and also absence of temperature-chaos, 
as it should be in REM. 
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3. Generating functional for correlation functions of Y 



Now let us consider fluctuations of the variable Y and construct a generating functional for its correlation functions. 
We consider again p real replicas r — l,...,p, which are replicated further into n r replicas, at the same temperature 
but at slightly different fields h + 8h r . 
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(G19) 



Note T c ° is the critical temperature at h = given by Eq. (|B8[) and A is the variance of the original Y variable. 
The 2nd term in the exponent of the r.h.s of the last equation can be expanded as, 



NA 



2 AT / P 



E E ft h+ Sh *) E 5 * 



NA 2 



w 2 E^ 



=1 \r=l 
v 



a— (r, 1) 
(r,n r ) 



7=1 



/VA 2 P (r,n r ) («,1>.) 

+iV A 2 ^(/3<5M E ™'(«) + -o- E (06hr)(06h 3 ) E E 



(G20) 



r=l 



a=(r,l) 



r,s=l 



=(r,l)/3=( S ,l) 



Note that the 2nd term on the r.h.s. of Eq. (|G20[) can be decomposed as, 
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r=l 



where <5/i Q is the probing field applied to replica a. Here again we find the probing field Sh r in a cluster Cj is linearly 
coupled to fluctuation of mj. 

It can be seen that the coupling between the fluctuations of the size of clusters and 8h r is absent only in the special 
case that the applied external field h = 0. Note also that such a situation never happens for the case of energies (See 
Eq. ([G2T]) ) in the whole glass phase T < T c (h). 

Exponentiating the 2nd term in the r.h.s. of Eq. (|G21[) and applying the measure for the fluctuation of Smi given 
in Eq. (|G11[) we obtain, 
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in the last equations we changed the integration variable to 6m' r = Smj + J2 ae c, 2c(/3T (h)) 2 {0h){(38h a ) . The last 
result implies we have another 2nd order term in the action 
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Combining with the 3rd term on the r.h.s. of Eq. (|G20|) and using Eq. (|B8[) we obtain the total 0{8h) 2 term to be, 
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with "renormalized variance" 



A nff = 



A 



Note that this coincides with Eq. (|B4|) . 

Now collecting also the 1st term in the r.h.s of Eq. (|G2ip we finally obtain, 
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It can be seen easily that the 0(8h) term in the action generates the average 

\[{Y)\ 



dF a9 T 
= TV A 2 

dh r c {h) 



(G23) 



(G24) 



(G25) 



with A being the variance of the original Y variable. It agrees precisely with the thermodynamic one Eq. (|B10p ). 
Moreover the 0{{8h) 2 ) generates the average linear susceptibility which also agrees with the thermodynamic one 
Eq. ([BIT)) . 
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